00010000:00010000:1.0F:1788201478.007080:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201478.341149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201478.341218:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0F:1788201478.341342:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401152 00000100:00100000:0.0:1788201478.341363:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401152 00000100:00100000:1.0:1788201478.341394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201478.341421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201478.341439:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201478.341439:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:0.0:1788201478.341452:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2400:x1875064662401152:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201478.341461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201478.341479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201478.341495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201478.341546:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2400:x1875064662401152:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 96us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201478.341555:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:1.0:1788201478.341798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0F:1788201478.341858:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401408 00000100:00100000:3.0:1788201478.341869:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401408 00000100:00100000:3.0:1788201478.341917:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401920 00000100:00100000:3.0:1788201478.341920:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401920 00000100:00100000:3.0:1788201478.341934:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401280 00000100:00100000:3.0:1788201478.341936:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401280 00000100:00100000:3.0:1788201478.341949:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401792 00000100:00100000:3.0:1788201478.341952:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401792 00000100:00100000:3.0:1788201478.341969:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:3.0:1788201478.341976:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662401408:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201478.342017:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662401408:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 41us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201478.342024:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:3.0:1788201478.342037:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:3.0:1788201478.342043:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662401920:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201478.342065:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662401920:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201478.342071:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:3.0:1788201478.342082:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:3.0:1788201478.342087:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+22:2400:x1875064662401280:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201478.342114:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+22:2400:x1875064662401280:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201478.342120:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:3.0:1788201478.342132:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:3.0:1788201478.342137:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2400:x1875064662401792:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201478.342162:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2400:x1875064662401792:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:2.0F:1788201478.342176:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401664 00000100:00100000:3.0:1788201478.342177:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1788201478.342189:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401664 00000100:00080000:3.0:1788201478.342200:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201478.342207:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201478.342210:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201478.342230:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662402176 00000100:00100000:2.0:1788201478.342234:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662402176 00000100:00100000:1.0:1788201478.342463:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662401536 00000100:00100000:1.0:1788201478.342468:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662401536 00000100:00100000:1.0:1788201478.342501:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662402048 00000100:00100000:1.0:1788201478.342504:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662402048 00000100:00100000:1.0:1788201478.342576:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1788201478.342609:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662401664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201478.342623:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:2.0:1788201478.342630:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662401536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201478.342645:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662401664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 62us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201478.342652:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1788201478.342654:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02286e61-118a-46f7-9134-2c74a0c116ce+5:2400:x1875064662401536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201478.342660:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1788201478.342665:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:2.0:1788201478.342671:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:1.0:1788201478.342671:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662402048:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201478.342676:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662402176:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201478.342694:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662402176:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 17us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201478.342694:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2400:x1875064662402048:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201478.342700:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:2.0:1788201478.342707:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00080000:1.0:1788201478.342773:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201478.342776:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788201478.773931:0:17275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788201478.773939:0:17275:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201478.773965:0:17275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788201478.773972:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788201479.030960:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201480.054178:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201480.573677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201480.575124:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662402304 00000100:00100000:3.0:1788201480.575140:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662402304 00000100:00100000:3.0:1788201480.575228:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:3.0:1788201480.575240:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+22:15592:x1875064662402304:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788201480.575381:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+22:15592:x1875064662402304:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 143us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201480.575389:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00080000:1.0:1788201480.576243:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201480.577909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201480.584130:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662402432 00000100:00100000:0.0:1788201480.584150:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662402432 00000100:00100000:0.0:1788201480.584241:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:0.0:1788201480.584252:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+5:15592:x1875064662402432:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788201480.584472:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201480.585078:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+5:15592:x1875064662402432:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 143us (6493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201480.585091:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:3.0:1788201480.590878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201480.590920:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662402688 00000100:00100000:3.0:1788201480.590933:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662402688 00000100:00100000:3.0:1788201480.590994:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1788201480.591006:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+22:15592:x1875064662402688:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788201480.591304:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+23:15592:x1875064662402688:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 299us (438us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788201480.591314:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000001:00080000:3.0:1788201480.609276:0:17220:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1788201480.609313:0:17220:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce0886d6b40 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1788201480.609320:0:17220:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0a039d100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce0886d6240 00000020:00080000:3.0:1788201480.609324:0:17220:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ce0a039d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ce0b622f800 00010000:00010000:3.0:1788201480.609386:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201480.609400:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201480.609409:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201480.609416:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201480.609441:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201480.609451:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201480.609532:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:3.0:1788201480.609535:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201480.609542:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201480.609551:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae200/0xf9b71aee44721b66 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201480.609928:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1788201480.610024:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788201481.078097:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201481.847045:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681350784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201481.847151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201481.847227:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350784 00000100:00100000:3.0:1788201481.847238:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350784 00000100:00100000:3.0:1788201481.847327:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201481.847339:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681350784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201481.847639:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788201481.847710:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681350784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 372us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201481.847774:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201481.847885:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681350784:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201481.848009:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201482.104016:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201482.295976:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201482.358015:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201482.358046:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681350912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201482.358103:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681351168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201482.358141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201482.358234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201482.358262:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201482.358268:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681351040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201482.358296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201482.358338:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681350912 00000100:00100000:1.0:1788201482.358347:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681350912 00000100:00100000:1.0:1788201482.358393:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351168 00000100:00100000:1.0:1788201482.358396:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351168 00000100:00100000:1.0:1788201482.358414:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201482.358424:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681350912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201482.358445:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351040 00000100:00100000:2.0:1788201482.358449:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351040 00000004:00000024:1.0:1788201482.358471:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788201482.358526:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681350912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201482.358532:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201482.358550:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201482.358555:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681351168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201482.358576:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788201482.358628:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681351168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201482.358634:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201482.358685:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681351168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201482.358735:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681350912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201482.359121:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681351552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201482.359158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.359182:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681352064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359182:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201482.359189:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681351040:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201482.359203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788201482.359207:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788201482.359236:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201482.359242:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681351680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359242:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681351040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201482.359259:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201482.359265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.359281:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681352192:0@lo:400:kworker.0 00000100:00080000:2.0:1788201482.359294:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201482.359303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.359330:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351552 00000100:00100000:2.0:1788201482.359333:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681351040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201482.359334:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351552 00000100:00100000:2.0:1788201482.359349:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681351296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201482.359360:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352064 00000100:00100000:3.0:1788201482.359363:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352064 00000100:00100000:2.0:1788201482.359379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.359381:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352192 00000100:00100000:3.0:1788201482.359383:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352192 00000100:00100000:3.0:1788201482.359396:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201482.359402:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681351552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359402:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681351808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201482.359435:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681352320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201482.359436:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681351552:12345-0@lo:400:kworker.0 Request processed in 35us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.359443:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201482.359453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.359454:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351808 00000100:00100000:3.0:1788201482.359457:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351808 00000100:00100000:3.0:1788201482.359468:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352320 00000100:00100000:3.0:1788201482.359471:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352320 00000100:00100000:2.0:1788201482.359476:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201482.359481:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681351424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201482.359484:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201482.359489:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681352064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201482.359522:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681351936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201482.359523:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681352064:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.359529:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201482.359541:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201482.359541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.359547:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681352192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359561:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351680 00000100:00100000:2.0:1788201482.359564:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351680 00000100:00100000:3.0:1788201482.359570:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681352192:12345-0@lo:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.359576:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201482.359584:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351936 00000100:00100000:3.0:1788201482.359587:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351936 00000100:00100000:2.0:1788201482.359588:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351424 00000100:00100000:2.0:1788201482.359590:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351424 00000100:00100000:3.0:1788201482.359601:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201482.359605:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201482.359606:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681351808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359610:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201482.359637:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681351808:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.359644:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201482.359649:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681351680:12345-0@lo:400:kworker.0 Request processed in 39us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201482.359654:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201482.359655:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201482.359660:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681352320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359663:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201482.359668:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681351424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201482.359684:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681352320:12345-0@lo:400:kworker.0 Request processed in 24us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.359689:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201482.359696:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681351424:12345-0@lo:400:kworker.0 Request processed in 28us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.359699:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201482.359702:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201482.359704:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce09e1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681351936:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201482.359760:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201482.359764:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201482.359767:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201482.359789:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681351680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359800:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681352192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359809:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681351552:0@lo:400:kworker.0 00010000:00080000:2.0:1788201482.359827:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf6ab800 x1875064681352064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201482.359838:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681352064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359871:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681351424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201482.359880:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681351808:0@lo:400:kworker.0 00010000:00080000:2.0:1788201482.359889:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf841c5880 x1875064681352320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201482.359898:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681352320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201482.359913:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681351296 00000100:00100000:0.0:1788201482.359918:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681351296 00000100:00100000:0.0:1788201482.359962:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201482.359969:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681351296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201482.360010:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681351296:12345-0@lo:400:kworker.0 Request processed in 42us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201482.360016:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201482.360075:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681352448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201482.360101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201482.360140:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681351296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201482.360165:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352448 00000100:00100000:0.0:1788201482.360175:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352448 00000100:00100000:0.0:1788201482.360200:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201482.360207:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681352448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201482.360227:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788201482.360267:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681352448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201482.360274:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201482.360382:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681352448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201482.364292:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681352576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201482.364389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.365303:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce09e1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681351936:12345-0@lo:400:kworker.0 Request processed in 5594us (5756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.365317:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201482.365404:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681351936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201482.365473:0:20379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352576 00000100:00100000:1.0:1788201482.365482:0:20379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352576 00000100:00100000:1.0:1788201482.365540:0:20379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201482.365551:0:20379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681352576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201482.365572:0:20379:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788201482.365630:0:20379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681352576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201482.365636:0:20379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201482.365728:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681352576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201483.126029:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201483.457409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201483.457464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201483.457500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201483.457617:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662403072 00000100:00100000:1.0:1788201483.457630:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662403072 00000100:00100000:0.0:1788201483.457724:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662402816 00000100:00100000:0.0:1788201483.457729:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662402816 00000100:00080000:3.0:1788201483.457778:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201483.457846:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:0.0:1788201483.457858:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2398:x1875064662402816:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201483.457868:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662402944 00000100:00100000:1.0:1788201483.457871:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662402944 00000100:00100000:1.0:1788201483.457893:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:1.0:1788201483.457901:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+5:2398:x1875064662403072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201483.457987:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:3.0:1788201483.457996:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+13:2398:x1875064662402944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201483.458013:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2398:x1875064662402816:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 89us (551us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201483.458020:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201483.458025:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:1.0:1788201483.464839:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02286e61-118a-46f7-9134-2c74a0c116ce+5:2398:x1875064662403072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 6919us (7354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201483.464858:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:3.0:1788201483.465083:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+13:2398:x1875064662402944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 7086us (7579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201483.465092:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:0.0:1788201483.468807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201483.468866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201483.468887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201483.468911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201483.468933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201483.468971:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662403328 00000100:00100000:2.0:1788201483.468983:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662403328 00000100:00100000:2.0:1788201483.469055:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662403200 00000100:00100000:2.0:1788201483.469059:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662403200 00000100:00100000:1.0:1788201483.469070:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662403584 00000100:00100000:1.0:1788201483.469076:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662403584 00000100:00100000:2.0:1788201483.469084:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662403712 00000100:00100000:2.0:1788201483.469089:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662403712 00000100:00100000:2.0:1788201483.469118:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:1.0:1788201483.469128:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662403456 00000100:00100000:1.0:1788201483.469132:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662403456 00000100:00100000:2.0:1788201483.469143:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02286e61-118a-46f7-9134-2c74a0c116ce+5:2399:x1875064662403328:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201483.469182:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:1.0:1788201483.469191:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2399:x1875064662403584:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201483.469229:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1788201483.469239:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02286e61-118a-46f7-9134-2c74a0c116ce+5:2397:x1875064662403200:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:3.0:1788201483.469267:0:18747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721895 00000100:00100000:1.0:1788201483.469271:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2399:x1875064662403584:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 82us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201483.469278:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00080000:3.0:1788201483.469286:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9cdf819de000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201483.469295:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:1.0:1788201483.469301:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2399:x1875064662403456:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201483.469328:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2399:x1875064662403456:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201483.469334:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00000001:00000004:3.0:1788201483.469357:0:18747:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788201483.469383:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:1.0:1788201483.469389:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2397:x1875064662403712:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:1.0:1788201483.469407:0:18748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447218d4 00000100:00080000:1.0:1788201483.469414:0:18748:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5bee800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201483.469431:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02286e61-118a-46f7-9134-2c74a0c116ce+5:2399:x1875064662403328:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 302us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201483.469440:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000001:00000004:1.0:1788201483.469446:0:18748:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1788201483.469473:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201483.469479:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201483.469482:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201483.469485:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201483.469511:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201483.469512:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c61bae8-443f-4aeb-9491-45500cbfe20c+2:2397:x1875064662403712:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 122us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201483.469523:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00010000:00010000:2.0:1788201483.469538:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201483.469648:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02286e61-118a-46f7-9134-2c74a0c116ce+2:2397:x1875064662403200:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 409us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201483.469655:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:0.0:1788201483.469859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201483.469950:0:19636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662403840 00000100:00100000:1.0:1788201483.469955:0:19636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662403840 00000100:00100000:1.0:1788201483.469991:0:19636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1788201483.469997:0:19636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2397:x1875064662403840:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:1.0:1788201483.470011:0:19636:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447218db 00000100:00080000:1.0:1788201483.470021:0:19636:0:(import.c:65:import_set_state_nolock()) ffff9cdf819dc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201483.470047:0:19636:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:0.0:1788201483.470115:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201483.470135:0:19636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c61bae8-443f-4aeb-9491-45500cbfe20c+2:2397:x1875064662403840:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 137us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201483.470143:0:19636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00080000:3.0:1788201483.470933:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788201484.017377:0:20617:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 14:38:01 (1788201481) 00010000:00010000:2.0:1788201484.155597:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201485.175561:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201486.198049:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788201486.460422:0:17220:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1788201486.460858:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1788201486.460873:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:2.0:1788201486.966147:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201486.968132:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681352704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201486.968248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201486.973070:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352704 00000100:00100000:0.0:1788201486.973091:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352704 00000100:00100000:0.0:1788201486.973189:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201486.973202:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681352704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201486.973246:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788201486.973378:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681352704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 179us (5128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201486.973386:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201486.973698:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681352704:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201486.973813:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201487.222554:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201487.478311:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681353216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.478425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.478510:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681353728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.478538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.478556:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681354240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.478577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201487.478775:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681352960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201487.478812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201487.478840:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681353472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201487.478861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201487.478879:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681353984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201487.478924:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352960 00000100:00100000:3.0:1788201487.478933:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352960 00000100:00100000:3.0:1788201487.478984:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353472 00000100:00100000:3.0:1788201487.478987:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353472 00000100:00100000:3.0:1788201487.479006:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201487.479015:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681352960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201487.479079:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681352960:12345-0@lo:400:kworker.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201487.479086:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201487.479105:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201487.479111:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681353472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201487.479138:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681353472:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201487.479144:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201487.479432:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201487.479440:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681353088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.479469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.479488:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681353600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.479510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.479528:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681354112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.479550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201487.479645:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681352832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.479695:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201487.479733:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681353344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.479778:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353216 00000100:00100000:2.0:1788201487.479783:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353216 00000100:00100000:2.0:1788201487.479828:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353088 00000100:00100000:2.0:1788201487.479831:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353088 00000100:00100000:2.0:1788201487.479852:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353600 00000100:00100000:2.0:1788201487.479854:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353600 00000100:00100000:2.0:1788201487.479869:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201487.479875:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681353216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.479916:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681353216:12345-0@lo:400:kworker.0 Request processed in 41us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201487.479923:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201487.479935:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201487.479941:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681353088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.479968:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681353088:12345-0@lo:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201487.479973:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201487.479983:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201487.479989:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681353600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.480012:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681353600:12345-0@lo:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201487.480018:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201487.480068:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681352832 00000100:00100000:2.0:1788201487.480071:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681352832 00000100:00100000:2.0:1788201487.480100:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201487.480106:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681352832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.480136:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3646:x1875064681352832:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201487.480149:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788201487.480187:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201487.480192:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201487.480288:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681354624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201487.480316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201487.480340:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201487.480345:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681354752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201487.480369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201487.480404:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681354624 00000100:00100000:2.0:1788201487.480408:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681354624 00000100:00100000:2.0:1788201487.480435:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201487.480442:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681354624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201487.480468:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788201487.480503:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681354624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201487.480510:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201487.480560:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681354624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201487.480590:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681354752 00000100:00100000:2.0:1788201487.480593:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681354752 00000100:00100000:2.0:1788201487.480616:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201487.480622:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681354752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201487.480647:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201487.480692:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681354752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201487.480699:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201487.480727:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681354752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201487.482597:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353728 00000100:00100000:1.0:1788201487.482614:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353728 00000100:00100000:0.0:1788201487.482692:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681353216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.482697:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681354240 00000100:00100000:1.0:1788201487.482702:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681354240 00000100:00100000:0.0:1788201487.482731:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681353088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.482733:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681354112 00000100:00100000:1.0:1788201487.482761:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681354112 00000100:00100000:0.0:1788201487.482769:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681353600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.482790:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201487.482803:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681353728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.482809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.482835:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681353856:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.482881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201487.482903:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681353728:12345-0@lo:400:kworker.0 Request processed in 101us (4362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.482904:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681354368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201487.482917:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201487.482938:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353344 00000100:00100000:1.0:1788201487.482942:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353344 00000100:00100000:0.0:1788201487.482942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201487.482958:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353856 00000100:00100000:1.0:1788201487.482962:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353856 00000100:00100000:0.0:1788201487.482989:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681354880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201487.483033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.483059:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681352832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.483073:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201487.483079:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681354496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201487.483100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.483128:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681354880 00000100:00100000:0.0:1788201487.483132:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681354880 00000100:00100000:0.0:1788201487.483170:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681354496 00000100:00100000:0.0:1788201487.483174:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681354496 00000100:00100000:0.0:1788201487.483189:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201487.483196:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681354880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201487.483214:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788201487.483249:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681354880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.483255:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201487.483267:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201487.483273:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681354496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201487.483283:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788201487.483307:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681354496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.483313:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201487.483351:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681354496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201487.483367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681354880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201487.483391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.483430:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681352960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.483442:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681353472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.483464:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681354368 00000100:00100000:0.0:1788201487.483467:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681354368 00000100:00100000:0.0:1788201487.483492:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201487.483499:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681354368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201487.483527:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788201487.483561:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681354368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.483566:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201487.483596:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681354368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201487.483622:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681353728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.483659:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681353984 00000100:00100000:0.0:1788201487.483662:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681353984 00000100:00100000:0.0:1788201487.483695:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201487.483702:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681354240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.483768:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681354240:12345-0@lo:400:kworker.0 Request processed in 66us (5189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.483775:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201487.483790:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201487.483798:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681354112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.483830:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201487.483839:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681353344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.483846:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681354112:12345-0@lo:400:kworker.0 Request processed in 48us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.483853:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201487.483868:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201487.483884:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681353984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.483893:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681353344:12345-0@lo:400:kworker.0 Request processed in 54us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.483901:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201487.483918:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201487.483925:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681353984:12345-0@lo:400:kworker.0 Request processed in 43us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.483929:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681353856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.483940:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788201487.483962:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201487.483967:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201487.483984:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681353856:12345-0@lo:400:kworker.0 Request processed in 58us (1101us total) trans 0 rc 0/0 00010000:00080000:0.0:1788201487.483993:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b8700 x1875064681353984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201487.484002:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201487.484012:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681353984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.484044:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681354112:0@lo:400:kworker.0 00010000:00080000:0.0:1788201487.484055:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0ba3b8000 x1875064681354240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201487.484064:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681354240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.484095:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681353344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.484106:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681353856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201487.652155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201487.655373:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662404096 00000100:00100000:2.0:1788201487.655395:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662404096 00000100:00100000:3.0:1788201487.655789:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1788201487.655803:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+13:16353:x1875064662404096:12345-192.168.203.2@tcp:35:umount.0 00000001:00080000:3.0:1788201487.656131:0:17243:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788201487.656234:0:17243:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1788201487.656413:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02286e61-118a-46f7-9134-2c74a0c116ce+16:16353:x1875064662404096:12345-192.168.203.2@tcp:35:umount.0 Request processed in 612us (4272us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788201487.656422:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000020:00080000:3.0:1788201487.656428:0:17243:0:(tgt_main.c:807:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1788201487.657355:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201487.660184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201487.660234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201487.660263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201487.660360:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662404224 00000100:00100000:0.0:1788201487.660373:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662404224 00000100:00100000:0.0:1788201487.660434:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662404480 00000100:00100000:0.0:1788201487.660438:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662404480 00000100:00100000:0.0:1788201487.660450:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662404352 00000100:00100000:0.0:1788201487.660453:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662404352 00000100:00100000:0.0:1788201487.660470:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:0.0:1788201487.660492:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2ec582-f6a7-44d0-975e-32edaafa1016+15:2398:x1875064662404224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201487.660513:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201487.660563:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367ca00/0xf9b71aee44721872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3fa expref: 15 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201487.660586:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201487.660659:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2ec582-f6a7-44d0-975e-32edaafa1016+14:2398:x1875064662404224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 169us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.660668:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:0.0:1788201487.660698:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1788201487.660705:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba260450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2ec582-f6a7-44d0-975e-32edaafa1016+13:2398:x1875064662404480:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201487.660712:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201487.660722:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce080030000/0xf9b71aee447218fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4e1 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201487.660732:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201487.660801:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba260450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2ec582-f6a7-44d0-975e-32edaafa1016+12:2398:x1875064662404480:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 96us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.660808:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1788201487.660853:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1788201487.660860:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2ec582-f6a7-44d0-975e-32edaafa1016+11:2398:x1875064662404352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201487.660867:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201487.660876:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03af200/0xf9b71aee44721879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc42b expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201487.660885:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201487.660900:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2ec582-f6a7-44d0-975e-32edaafa1016+10:2398:x1875064662404352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 41us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.660907:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1788201487.664185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201487.664377:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662404608 00000100:00100000:0.0:1788201487.664390:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662404608 00000100:00100000:0.0:1788201487.664496:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:0.0:1788201487.664509:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+5:2397:x1875064662404608:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:0.0:1788201487.664686:0:18746:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472189c 00000100:00080000:0.0:1788201487.664698:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9cdf819df800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201487.664860:0:18746:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788201487.665700:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02286e61-118a-46f7-9134-2c74a0c116ce+2:2397:x1875064662404608:12345-192.168.203.2@tcp:9:umount.0 Request processed in 1188us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.665712:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00080000:2.0:1788201487.666846:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201487.671129:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201487.694369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201487.694851:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662405504 00000100:00100000:0.0:1788201487.694864:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662405504 00000100:00100000:0.0:1788201487.694944:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:0.0:1788201487.694956:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+16:2397:x1875064662405504:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:0.0:1788201487.695009:0:19574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721887 00000020:00010000:0.0:1788201487.695030:0:19574:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9cdf831af000: total 0 00000100:00080000:0.0:1788201487.695037:0:19574:0:(import.c:65:import_set_state_nolock()) ffff9cdf831ab800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201487.695078:0:19574:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:2.0:1788201487.695449:0:17228:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9cdf831af000: total 0 00010000:00010000:2.0:1788201487.695455:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201487.695515:0:17228:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9cdf831af000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788201487.695569:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201487.695574:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201487.695585:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74400/0xf9b71aee44721b97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc59e expref: 15 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695611:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce086201500) 00010000:00010000:2.0:1788201487.695614:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201487.695618:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae600/0xf9b71aee4472196e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4ef expref: 14 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695643:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201487.695646:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201487.695649:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44721ab0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc551 expref: 13 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695663:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:2.0:1788201487.695666:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201487.695694:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367d600/0xf9b71aee447219ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4fd expref: 12 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695712:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce0b2f06e00) 00010000:00010000:2.0:1788201487.695715:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201487.695719:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44721b3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc57b expref: 11 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695796:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce0b2f06400) 00010000:00010000:2.0:1788201487.695799:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201487.695804:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf8367c800/0xf9b71aee44721952 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4e8 expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695821:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cdf81938000) 00010000:00010000:2.0:1788201487.695824:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201487.695828:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1a00/0xf9b71aee44721a32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc527 expref: 9 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695843:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cdf81938500) 00010000:00010000:2.0:1788201487.695846:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201487.695850:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255600/0xf9b71aee44721ae1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc566 expref: 8 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201487.695864:0:17228:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9cdf831af000, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1788201487.695878:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201487.695880:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201487.695882:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201487.696120:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02286e61-118a-46f7-9134-2c74a0c116ce+6:2397:x1875064662405504:12345-192.168.203.2@tcp:39:umount.0 Request processed in 1163us (1763us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788201487.696131:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:1.0:1788201487.710005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201487.710178:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662405632 00000100:00100000:3.0:1788201487.710192:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662405632 00000100:00100000:3.0:1788201487.710291:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:3.0:1788201487.710334:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+5:2397:x1875064662405632:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:3.0:1788201487.710383:0:17241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472188e 00000100:00080000:3.0:1788201487.710404:0:17241:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf445800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201487.710455:0:17241:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788201487.710504:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201487.710759:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201487.711171:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02286e61-118a-46f7-9134-2c74a0c116ce+3:2397:x1875064662405632:12345-192.168.203.2@tcp:39:umount.0 Request processed in 839us (1178us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788201487.711181:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00010000:00010000:3.0:1788201488.245957:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201488.579306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201488.579442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201488.579485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201488.583336:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662406016 00000100:00100000:3.0:1788201488.583356:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662406016 00000100:00100000:3.0:1788201488.583462:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662405888 00000100:00100000:3.0:1788201488.583465:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662405888 00000100:00100000:3.0:1788201488.583501:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:3.0:1788201488.583513:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2401:x1875064662406016:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201488.583633:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2401:x1875064662406016:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 122us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201488.583641:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:3.0:1788201488.583660:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:3.0:1788201488.583666:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2401:x1875064662405888:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201488.583701:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2401:x1875064662405888:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 35us (4216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201488.583707:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00080000:2.0:1788201488.584223:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201488.584229:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201488.584293:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662405760 00000100:00100000:0.0:1788201488.584299:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662405760 00000100:00100000:0.0:1788201488.584370:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:0.0:1788201488.584379:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+10:2401:x1875064662405760:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201488.584424:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2ec582-f6a7-44d0-975e-32edaafa1016+10:2401:x1875064662405760:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 47us (5135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201488.584446:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 173 00000040:00080000:1.0:1788201489.014042:0:17275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788201489.014055:0:17275:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788201489.014080:0:17275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788201489.014163:0:17275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788201489.270362:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201489.328844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201489.328873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201489.328901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201489.329000:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662406144 00000100:00100000:1.0:1788201489.329012:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662406144 00000100:00100000:1.0:1788201489.329079:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662406400 00000100:00100000:1.0:1788201489.329082:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662406400 00000100:00100000:1.0:1788201489.329107:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662406272 00000100:00100000:1.0:1788201489.329110:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662406272 00000100:00100000:1.0:1788201489.329130:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1788201489.329141:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2ec582-f6a7-44d0-975e-32edaafa1016+12:2400:x1875064662406144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201489.329178:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201489.329204:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254000/0xf9b71aee447218b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc46a expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201489.329228:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201489.329310:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2ec582-f6a7-44d0-975e-32edaafa1016+11:2400:x1875064662406144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 170us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201489.329318:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1788201489.329338:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201489.329344:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2ec582-f6a7-44d0-975e-32edaafa1016+10:2400:x1875064662406400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201489.329352:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201489.329361:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254800/0xf9b71aee447218f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc4da expref: 10 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201489.329394:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201489.329417:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2ec582-f6a7-44d0-975e-32edaafa1016+9:2400:x1875064662406400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 73us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201489.329424:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1788201489.329438:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:1.0:1788201489.329444:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2ec582-f6a7-44d0-975e-32edaafa1016+8:2400:x1875064662406272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201489.329451:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201489.329471:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367c200/0xf9b71aee447218b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc49b expref: 8 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201489.329481:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201489.329499:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2ec582-f6a7-44d0-975e-32edaafa1016+7:2400:x1875064662406272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 56us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201489.329506:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1788201489.350404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201489.350692:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662406656 00000100:00100000:0.0:1788201489.350704:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662406656 00000100:00100000:0.0:1788201489.350810:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1788201489.350821:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+6:2397:x1875064662406656:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:0.0:1788201489.350872:0:19574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447218c6 00000020:00010000:0.0:1788201489.350883:0:19574:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ce0bf45c800: total 0 00000100:00080000:0.0:1788201489.350889:0:19574:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201489.350923:0:19574:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1788201489.351124:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2397:x1875064662406656:12345-192.168.203.2@tcp:39:umount.0 Request processed in 304us (730us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788201489.351132:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000020:00010000:2.0:1788201489.351693:0:19639:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ce0bf45c800: total 0 00010000:00010000:2.0:1788201489.351791:0:19639:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ce0bf45c800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788201489.351831:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce0b2f06200) 00010000:00010000:2.0:1788201489.351836:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201489.351845:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee447219bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc504 expref: 4 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201489.351870:0:19639:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ce0bf45c800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788201489.351880:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201489.351882:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201489.351884:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201489.358453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201489.358535:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662406784 00000100:00100000:3.0:1788201489.358547:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662406784 00000100:00100000:3.0:1788201489.358616:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:3.0:1788201489.358644:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+5:2397:x1875064662406784:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:3.0:1788201489.358702:0:17241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447218cd 00000100:00080000:3.0:1788201489.358716:0:17241:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d0000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788201489.358878:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788201489.359046:0:17241:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788201489.360361:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c61bae8-443f-4aeb-9491-45500cbfe20c+3:2397:x1875064662406784:12345-192.168.203.2@tcp:39:umount.0 Request processed in 1710us (1914us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788201489.360373:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:1.0:1788201489.402276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201489.402519:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407040 00000100:00100000:2.0:1788201489.402532:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407040 00000100:00100000:2.0:1788201489.403876:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:2.0:1788201489.403908:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+7:2397:x1875064662407040:12345-192.168.203.2@tcp:251:umount.0 00000020:00000080:2.0:1788201489.403991:0:17235:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721864 00000020:00010000:2.0:1788201489.404001:0:17235:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ce0a03a2000: total 0 00000100:00080000:2.0:1788201489.404007:0:17235:0:(import.c:65:import_set_state_nolock()) ffff9ce0a03a5800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201489.404120:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2ec582-f6a7-44d0-975e-32edaafa1016+3:2397:x1875064662407040:12345-192.168.203.2@tcp:251:umount.0 Request processed in 227us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201489.404147:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 174 00000020:00010000:3.0:1788201489.404238:0:17228:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ce0a03a2000: total 0 00010000:00010000:3.0:1788201489.404325:0:17228:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ce0a03a2000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788201489.404367:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254e00/0xf9b71aee4472186b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc3f3 expref: 2 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201489.405040:0:17228:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ce0a03a2000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788201489.405068:0:17228:0:(genops.c:906:class_export_put()) final put ffff9ce0a03a2000/be2ec582-f6a7-44d0-975e-32edaafa1016 00010000:00010000:1.0:1788201489.405086:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201489.405097:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201489.405099:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201489.405122:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a03a2000/be2ec582-f6a7-44d0-975e-32edaafa1016 for MGS 00000020:00000080:1.0:1788201489.405486:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a03a5800 for MGS 00000001:00100000:3.0:1788201489.537910:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000020:00000080:3.0:1788201489.537925:0:18742:0:(genops.c:906:class_export_put()) final put ffff9cdf81980000/5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00100000:3.0:1788201489.537963:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00000020:00000080:3.0:1788201489.537966:0:18742:0:(genops.c:906:class_export_put()) final put ffff9cdf819db000/02286e61-118a-46f7-9134-2c74a0c116ce 00000020:00000080:2.0:1788201489.538019:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81980000/5c61bae8-443f-4aeb-9491-45500cbfe20c for lustre-OST0000 00000020:00000080:2.0:1788201489.538089:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819db000/02286e61-118a-46f7-9134-2c74a0c116ce for lustre-OST0000 00000020:00000080:2.0:1788201489.538111:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a5bee800 for lustre-OST0000 00000020:00000080:2.0:1788201489.538116:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf819de000 for lustre-OST0000 00000001:00100000:1.0:1788201489.542881:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00000020:00000080:1.0:1788201489.542896:0:19559:0:(genops.c:906:class_export_put()) final put ffff9cdf819dd800/02286e61-118a-46f7-9134-2c74a0c116ce 00000001:00100000:1.0:1788201489.543711:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000020:00000080:1.0:1788201489.543717:0:19559:0:(genops.c:906:class_export_put()) final put ffff9cdf819de800/5c61bae8-443f-4aeb-9491-45500cbfe20c 00000020:00000080:3.0:1788201489.546705:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819dd800/02286e61-118a-46f7-9134-2c74a0c116ce for lustre-OST0001 00000020:00000080:3.0:1788201489.546812:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf819df800 for lustre-OST0001 00000020:00000080:2.0:1788201489.548857:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819de800/5c61bae8-443f-4aeb-9491-45500cbfe20c for lustre-OST0001 00000020:00000080:2.0:1788201489.548935:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf819dc800 for lustre-OST0001 00010000:00010000:0.0:1788201490.301089:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201491.231822:0:20812:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788201491.243891:0:20812:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788201491.243970:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.243989:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.243997:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.244027:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.244048:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201491.244053:0:20812:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788201491.244087:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201491.244093:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201491.244099:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201491.244132:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf459000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788201491.244527:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201491.244537:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.244546:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201491.244550:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.244560:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201491.244568:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201491.244574:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201491.244577:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201491.244580:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788201491.244611:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.244618:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201491.244783:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.244801:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c600/0xf9b71aee44721427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472142e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.244818:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201491.244820:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201491.244822:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201491.244845:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681355136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201491.244942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201491.245060:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681355008:0@lo:39:umount.0 00000100:00100000:1.0:1788201491.245103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201491.246052:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355008 00000100:00100000:3.0:1788201491.246065:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355008 00000100:00100000:3.0:1788201491.246143:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788201491.246155:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875064681355008:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201491.246197:0:19574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721458 00000100:00080000:3.0:1788201491.246207:0:19574:0:(import.c:65:import_set_state_nolock()) ffff9ce0b322b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201491.246302:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875064681355008:12345-0@lo:39:umount.0 Request processed in 148us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201491.246310:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1788201491.246320:0:19574:0:(genops.c:906:class_export_put()) final put ffff9ce0b322f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788201491.246351:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b322f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201491.246406:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b322b000 for lustre-MDT0000 00010000:00010000:2.0:1788201491.246536:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201491.246549:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355136 00000100:00100000:2.0:1788201491.246554:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355136 00000100:00100000:2.0:1788201491.246599:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201491.246607:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+24:3647:x1875064681355136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201491.246619:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201491.246642:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855ba400/0xf9b71aee4472142e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721427 expref: 24 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.246881:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201491.246929:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:3647:x1875064681355136:12345-0@lo:103:ldlm_bl.0 Request processed in 324us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201491.246936:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201491.247014:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681355136:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788201491.247108:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf459000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201491.247159:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681355008:0@lo:39:umount.0 00000100:00080000:3.0:1788201491.247360:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201491.247365:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201491.247371:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201491.250548:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.250712:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.250721:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.250729:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.250886:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201491.250897:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.250905:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.250912:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.250919:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251226:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201491.251237:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251247:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255200 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201491.251251:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251270:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201491.251278:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201491.251285:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201491.251287:0:19639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788201491.251330:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251337:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201491.251372:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251380:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472137f expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251402:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201491.251406:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251411:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201491.251414:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251420:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201491.251425:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201491.251437:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201491.251439:0:19639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788201491.251454:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251459:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201491.251465:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.251472:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201491.251474:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201491.251476:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201491.251498:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681355392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201491.251526:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681355264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201491.251869:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201491.251877:0:20812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472185d expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201491.251892:0:20812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788201491.251904:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.251922:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.251928:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.251933:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201491.252004:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201491.252012:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201491.252019:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367da00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201491.252022:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201491.252029:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201491.252036:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201491.252041:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201491.252043:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788201491.252061:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201491.252067:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201491.252087:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201491.252095:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201491.252096:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201491.252098:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201491.252114:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201491.252132:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681355520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201491.252174:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201491.252179:0:20812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf8367da00/0xf9b71aee4472192f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721936 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201491.252189:0:20812:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788201491.252198:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.252205:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.252211:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.252217:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201491.252229:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201491.252232:0:20812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788201491.252235:0:20812:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788201491.252280:0:20812:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788201491.252285:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788201491.252291:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201491.252298:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788201491.252303:0:20812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9cdf8348a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201491.252309:0:20812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce0849b8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201491.252313:0:20812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce0a02ed800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201491.252318:0:20812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce0b9735000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201491.252327:0:20812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9ce0bf45c800 5c61bae8-443f-4aeb-9491-45500cbfe20c 192.168.203.2@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788201491.252332:0:20812:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9cdf831af000 02286e61-118a-46f7-9134-2c74a0c116ce 192.168.203.2@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1788201491.252338:0:20812:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9cdf831e99c0) has exports, disconnecting them 00000020:00080000:3.0:1788201491.252342:0:20812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cdf8348a800), last request at 1788201487 00000020:00000080:3.0:1788201491.252350:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472168f 00000100:00080000:3.0:1788201491.252372:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348b800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788201491.252396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788201491.252425:0:20812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf8348a800): rc 0 00000020:00000080:3.0:1788201491.252428:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf8348a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788201491.252439:0:20812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce0849b8000), last request at 1788201487 00000020:00000080:3.0:1788201491.252441:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447215fc 00000100:00080000:3.0:1788201491.252447:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ce0849be000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201491.252452:0:20812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0849b8000): rc 0 00000020:00000080:3.0:1788201491.252454:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0849b8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788201491.252458:0:20812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce0a02ed800), last request at 1788201420 00000020:00000080:3.0:1788201491.252460:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721546 00000100:00080000:3.0:1788201491.252463:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02ee000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201491.252468:0:20812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0a02ed800): rc 0 00000020:00000080:3.0:1788201491.252469:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0a02ed800/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00100000:0.0:1788201491.252470:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355264 00000100:00100000:0.0:1788201491.252479:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355264 00000020:00080000:3.0:1788201491.252480:0:20812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce0b9735000), last request at 1788201420 00000020:00000080:3.0:1788201491.252484:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214eb 00000100:00080000:3.0:1788201491.252488:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9737800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201491.252495:0:20812:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:0.0:1788201491.252535:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201491.252545:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:3644:x1875064681355264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201491.252559:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201491.252578:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0e00/0xf9b71aee4472137f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721378 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201491.252593:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:3.0:1788201491.252774:0:20812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0b9735000): rc 0 00000004:00000080:3.0:1788201491.252782:0:20812:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc15181587ae0 00000100:00080000:3.0:1788201491.252805:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201491.252809:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788201491.253045:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:3644:x1875064681355264:12345-0@lo:103:ldlm_bl.0 Request processed in 499us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201491.253064:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201491.253113:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681355264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201491.253182:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201491.253189:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201491.253197:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201491.253201:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201491.253209:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201491.253217:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201491.253223:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201491.253225:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788201491.253227:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788201491.253251:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201491.253257:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201491.253269:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201491.253276:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255800/0xf9b71aee4472136a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721371 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201491.253420:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201491.253422:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201491.253424:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201491.253431:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201491.253441:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8198df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681355648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201491.253477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201491.254010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201491.254060:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201491.254072:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355648 00000020:00000080:2.0:1788201491.254073:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8348a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1788201491.254078:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355648 00000020:00000080:2.0:1788201491.254128:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0849b8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1788201491.254129:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355392 00000100:00100000:0.0:1788201491.254133:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355392 00000020:00000080:2.0:1788201491.254154:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a02ed800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201491.254179:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf8348b800 for lustre-MDT0000 00000020:00000080:2.0:1788201491.254185:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0849be000 for lustre-MDT0000 00000020:00000080:2.0:1788201491.254188:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a02ee000 for lustre-MDT0000 00000100:00100000:2.0:1788201491.254211:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201491.254221:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+23:3646:x1875064681355648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201491.254236:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201491.254252:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bae00/0xf9b71aee44721371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4472136a expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201491.254283:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201491.254324:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+22:3646:x1875064681355648:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201491.254331:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201491.254366:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8198df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681355648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201491.254385:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201491.254469:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201491.254476:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba262450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+21:3645:x1875064681355392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201491.254484:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201491.254488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201491.254494:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03aec00/0xf9b71aee4472185d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721856 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201491.254504:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201491.254533:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba262450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:3645:x1875064681355392:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201491.254539:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201491.254579:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355520 00000100:00100000:0.0:1788201491.254583:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355520 00000100:00100000:0.0:1788201491.254599:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201491.254606:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+20:3647:x1875064681355520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201491.254612:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201491.254621:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721936 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4472192f expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201491.254623:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3645:1875064681355392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201491.254641:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201491.255083:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:3647:x1875064681355520:12345-0@lo:103:ldlm_bl.0 Request processed in 476us (593us total) trans 0 rc 0/0 00000100:00080000:3.0:1788201491.255084:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788201491.255090:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788201491.255108:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201491.255178:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681355776:0@lo:39:umount.0 00000100:00100000:1.0:1788201491.255217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201491.255257:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355776 00000100:00100000:1.0:1788201491.255262:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355776 00000100:00100000:1.0:1788201491.255297:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201491.255304:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875064681355776:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201491.255335:0:17246:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721570 00000100:00080000:1.0:1788201491.255344:0:17246:0:(import.c:65:import_set_state_nolock()) ffff9ce0849b9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201491.255371:0:17246:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788201491.255519:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3643:x1875064681355776:12345-0@lo:39:umount.0 Request processed in 214us (301us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788201491.255526:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201491.257853:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681355520:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788201491.257940:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201491.257953:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681355776:0@lo:39:umount.0 00010000:00010000:1.0:1788201491.257975:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201491.259196:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201491.259204:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788201491.259259:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788201491.259325:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788201491.259361:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788201491.259386:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201491.259388:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1788201491.259406:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788201491.259471:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788201491.259482:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788201491.259535:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9cdf831e99c0) has no exports 00000100:00100000:1.0:1788201491.259910:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681355904:0@lo:9:umount.0 00000100:00100000:1.0:1788201491.260001:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201491.260053:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681356032:0@lo:9:umount.0 00000100:00100000:1.0:1788201491.260076:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201491.260266:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681355904 00000100:00100000:3.0:1788201491.260275:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681355904 00000100:00100000:3.0:1788201491.260345:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356032 00000100:00100000:3.0:1788201491.260349:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356032 00000100:00100000:3.0:1788201491.260376:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201491.260387:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875064681355904:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201491.260419:0:18747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447216b2 00000100:00080000:3.0:1788201491.260430:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201491.260492:0:18747:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788201491.260799:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1875064681355904:12345-0@lo:9:umount.0 Request processed in 412us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201491.260808:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201491.260826:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201491.260833:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875064681356032:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201491.260847:0:18747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447216b9 00000100:00080000:3.0:1788201491.260853:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201491.260879:0:18747:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788201491.260965:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1875064681356032:12345-0@lo:9:umount.0 Request processed in 133us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201491.260972:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788201491.261085:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201491.261090:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201491.261125:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1788201491.261332:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201491.261339:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201491.261547:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201491.261558:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201491.261563:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681355904:0@lo:9:umount.0 00000100:00080000:1.0:1788201491.261581:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce083419000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201491.261825:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201491.262021:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201491.262027:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681356032:0@lo:9:umount.0 00000020:00080000:3.0:1788201491.267027:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9cdf831e99c0) has no exports 00000020:00000080:3.0:1788201491.330435:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213c5 00000020:00000080:3.0:1788201491.330449:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0aafdc800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788201491.330468:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788201491.330531:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0aafdc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201491.330584:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201491.330597:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201491.330603:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9ce0bf450000) has no exports 00000020:00000080:2.0:1788201491.331058:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213be 00000020:00000080:2.0:1788201491.331068:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf831fd800/lustre-MDT0000-osd_UUID 00010000:00010000:1.0:1788201491.331075:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201491.331144:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201491.331155:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201491.331159:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf831fc000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788201491.331162:0:20812:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf831fc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788201491.331168:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788201491.331175:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf831fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788201492.086388:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201492.086423:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681356160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201492.086542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201492.086667:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356160 00000100:00100000:2.0:1788201492.086678:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356160 00000100:00100000:2.0:1788201492.086785:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201492.086798:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681356160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201492.086838:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788201492.086905:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681356160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201492.086934:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788201492.087173:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201492.087253:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681356160:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201492.342267:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201492.534929:0:17995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201492.599671:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201492.599705:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681356288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201492.599831:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201492.599927:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356288 00000100:00100000:3.0:1788201492.599937:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356288 00000100:00100000:3.0:1788201492.599991:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201492.600000:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875064681356288:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788201492.600009:0:17246:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201492.600052:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875064681356288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (221us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201492.600078:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788201492.600637:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681356416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.600694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201492.600727:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681356928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.600775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201492.600801:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201492.600807:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681356544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.600832:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201492.600847:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681357056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.600870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201492.600901:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356928 00000100:00100000:2.0:1788201492.600905:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356928 00000100:00100000:2.0:1788201492.600950:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357056 00000100:00100000:2.0:1788201492.600953:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357056 00000100:00100000:2.0:1788201492.600967:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201492.600975:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681356928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.601024:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681356928:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201492.601029:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201492.601045:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201492.601049:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875064681357056:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201492.601053:0:17240:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201492.601080:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875064681357056:12345-0@lo:400:kworker.0 Request processed in 30us (208us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201492.601087:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788201492.601122:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201492.601283:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681356800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201492.601284:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356416 00000100:00100000:0.0:1788201492.601291:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356416 00000100:00100000:1.0:1788201492.601325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201492.601344:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788201492.601354:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681357312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201492.601356:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba5ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:3646:x1875064681356416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.601394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201492.601411:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba5ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7+19:3646:x1875064681356416:12345-0@lo:400:kworker.0 Request processed in 59us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201492.601418:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788201492.601425:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201492.601434:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681356672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.601460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201492.601478:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681357184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.601505:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201492.601532:0:20379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357312 00000100:00100000:1.0:1788201492.601536:0:20379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357312 00000100:00100000:0.0:1788201492.601563:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356544 00000100:00100000:0.0:1788201492.601570:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356544 00000100:00100000:1.0:1788201492.601575:0:20379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201492.601587:0:20379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875064681357312:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201492.601608:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00002000:00000024:1.0:1788201492.601617:0:20379:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788201492.601619:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681356544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.601685:0:20379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875064681357312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201492.601689:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8198f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681356544:12345-0@lo:400:kworker.0 Request processed in 71us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201492.601701:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201492.601706:0:20379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201492.601733:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356800 00000100:00100000:1.0:1788201492.601757:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356800 00000100:00100000:1.0:1788201492.601775:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681356672 00000100:00100000:1.0:1788201492.601778:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681356672 00000100:00100000:0.0:1788201492.601780:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357184 00000100:00100000:0.0:1788201492.601786:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357184 00000100:00100000:1.0:1788201492.601793:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201492.601799:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875064681356800:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201492.601805:0:17242:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788201492.601814:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201492.601823:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681357184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.601840:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875064681356800:12345-0@lo:400:kworker.0 Request processed in 38us (515us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201492.601847:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201492.601866:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201492.601867:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681357184:12345-0@lo:400:kworker.0 Request processed in 44us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201492.601875:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875064681356672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201492.601880:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000020:00080000:1.0:1788201492.601884:0:17242:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201492.601916:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875064681356672:12345-0@lo:400:kworker.0 Request processed in 41us (454us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201492.601923:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788201492.601937:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201492.601944:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02e8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201492.601948:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788201492.602186:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681356544:0@lo:400:kworker.0 00000100:00080000:1.0:1788201492.602199:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201492.602202:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201492.602206:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201492.602212:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201492.602216:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1788201492.602224:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf826f1800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201492.602251:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba229c00 x1875064681357440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201492.602279:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681357056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.602295:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3646:1875064681356416:0@lo:400:kworker.0 00000100:02020000:3.0:1788201492.602303:0:3644:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00010000:00080000:1.0:1788201492.602311:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c1c00 x1875064681356928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201492.602325:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681356928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.602360:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681357440:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788201492.602389:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201492.602425:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357440 00000100:00100000:1.0:1788201492.602429:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357440 00000100:00100000:1.0:1788201492.602446:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201492.602450:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875064681357440:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788201492.602467:0:19574:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788201492.602508:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875064681357440:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 56us (118us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201492.602516:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788201492.602535:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201492.602543:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201492.602549:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201492.602553:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681357440:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788201492.620354:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201492.620367:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:0.0:1788201492.620379:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ce0a02e8000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201492.620435:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba3b0a80 x1875064681357568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201492.620480:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681356672:0@lo:400:kworker.0 00010000:00080000:0.0:1788201492.620529:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf4c3100 x1875064681357184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201492.620542:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681357184:0@lo:400:kworker.0 00000100:00080000:0.0:1788201492.620559:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201492.620565:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201492.620568:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201492.620572:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201492.620576:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 515 00000100:00080000:0.0:1788201492.620580:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cdf81986800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201492.620595:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba3b1f80 x1875064681357696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201492.620606:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681356800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201492.620637:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681357312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201492.620813:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681357568:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788201492.620900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201492.620942:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681357696:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788201492.620964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201492.621210:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357568 00000100:00100000:0.0:1788201492.621219:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357568 00000100:00100000:0.0:1788201492.621256:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357696 00000100:00100000:0.0:1788201492.621259:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357696 00000100:00100000:0.0:1788201492.621277:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201492.621286:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875064681357568:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788201492.621305:0:19574:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788201492.621356:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875064681357568:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 69us (455us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201492.621364:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201492.621383:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201492.621388:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875064681357696:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788201492.621396:0:19574:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788201492.621419:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875064681357696:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 29us (454us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201492.621424:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788201492.621651:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201492.621658:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201492.621663:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681357568:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788201492.621673:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201492.621676:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201492.621679:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681357696:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788201492.657119:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201492.657131:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201492.657137:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201492.657145:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201492.657150:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1788201492.657162:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce0870d7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201492.657358:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836caa00 x1875064681357824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201492.658327:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681357824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201492.658428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201492.659613:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357824 00000100:00100000:3.0:1788201492.659627:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357824 00000100:00100000:3.0:1788201492.659705:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201492.659715:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681357824:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788201492.659762:0:17246:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788201492.660029:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681357824:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 312us (1600us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201492.660037:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788201492.663997:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201492.664014:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201492.664021:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681357824:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1788201493.367294:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201493.628422:0:17220:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201493.628573:0:17220:0:(genops.c:906:class_export_put()) final put ffff9ce0b9735000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788201493.628607:0:17220:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00080000:0.0:1788201493.628620:0:17220:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788201493.628625:0:17220:0:(genops.c:906:class_export_put()) final put ffff9ce0bf45c800/5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00100000:0.0:1788201493.628645:0:17220:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00000001:00080000:0.0:1788201493.628649:0:17220:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788201493.628658:0:17220:0:(genops.c:906:class_export_put()) final put ffff9cdf831af000/02286e61-118a-46f7-9134-2c74a0c116ce 00000020:00000080:2.0:1788201493.629277:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9735000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201493.629602:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf45c800/5c61bae8-443f-4aeb-9491-45500cbfe20c for lustre-MDT0000 00000020:00000080:2.0:1788201493.629648:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf831af000/02286e61-118a-46f7-9134-2c74a0c116ce for lustre-MDT0000 00000020:00000080:2.0:1788201493.629685:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b9737800 for lustre-MDT0000 00000020:00000080:2.0:1788201493.629690:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf8348b000 for lustre-MDT0000 00000020:00000080:2.0:1788201493.629694:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf831ab800 for lustre-MDT0000 00000001:00100000:1.0:1788201493.630169:0:17973:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788201493.630183:0:17973:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788201493.630189:0:17973:0:(genops.c:906:class_export_put()) final put ffff9ce0b9731800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788201493.630284:0:17973:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5c61bae8-443f-4aeb-9491-45500cbfe20c 00000001:00080000:1.0:1788201493.630300:0:17973:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788201493.630303:0:17973:0:(genops.c:906:class_export_put()) final put ffff9ce0870d0800/5c61bae8-443f-4aeb-9491-45500cbfe20c 00000020:00000080:0.0:1788201493.630732:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9731800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:1.0:1788201493.630948:0:17973:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 02286e61-118a-46f7-9134-2c74a0c116ce 00000001:00080000:1.0:1788201493.630955:0:17973:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788201493.630959:0:17973:0:(genops.c:906:class_export_put()) final put ffff9cdf831ad000/02286e61-118a-46f7-9134-2c74a0c116ce 00000020:00000080:0.0:1788201493.631184:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0870d0800/5c61bae8-443f-4aeb-9491-45500cbfe20c for lustre-MDT0001 00000020:00000080:0.0:1788201493.631215:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf831ad000/02286e61-118a-46f7-9134-2c74a0c116ce for lustre-MDT0001 00000020:00000080:0.0:1788201493.631243:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0849b9800 for lustre-MDT0001 00000020:00000080:0.0:1788201493.631249:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0870d0000 for lustre-MDT0001 00000020:00000080:0.0:1788201493.631252:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf445800 for lustre-MDT0001 00010000:00010000:1.0:1788201494.390025:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201495.414047:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201496.441146:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201496.696595:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201496.696609:0:18742:0:(genops.c:906:class_export_put()) final put ffff9cdf8348c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201496.696884:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8348c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201496.696950:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf8348d000 for lustre-OST0000 00000001:00100000:0.0:1788201496.700586:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201496.700599:0:19559:0:(genops.c:906:class_export_put()) final put ffff9cdf83489800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201496.703851:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf83489800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788201496.703939:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf8348d800 for lustre-OST0001 00000100:00100000:1.0:1788201497.209020:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201497.209050:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681357952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201497.209143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.209222:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681357952 00000100:00100000:1.0:1788201497.209232:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681357952 00000100:00100000:1.0:1788201497.209295:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201497.209305:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681357952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201497.209341:0:18750:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201497.209407:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681357952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.209414:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788201497.209438:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201497.209496:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681357952:0@lo:13:osp-pre-0-1.0 00000020:01000000:2.0:1788201497.398333:0:20812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ce088616720 - data ffff9ce0abf331b0/ffff9ce0bb60f400 00000020:01000000:2.0:1788201497.398507:0:20812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf81bb7300 - data ffff9ce0abe74000/ffff9ce0bbdc4c00 00000001:00000004:2.0:1788201497.410852:0:20812:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788201497.451734:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201497.451773:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201497.451788:0:20812:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ce0bf680e00 x1875064681355776/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201501 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201497.451812:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788201497.457687:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201497.457694:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788201497.457754:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201497.457757:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201497.457978:0:17264:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201497.457983:0:17264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788201497.457999:0:17264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788201497.459065:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201497.459071:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788201497.459088:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201497.459102:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201497.461492:0:17266:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201497.461503:0:17266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1788201497.461520:0:17266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00010000:00010000:0.0:1788201497.464384:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201497.464872:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472138d 00000020:00000080:1.0:1788201497.464886:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbde000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201497.465653:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbde000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201497.470002:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213a2 00000020:00000080:1.0:1788201497.470020:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbdf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201497.470176:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788201497.470184:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201497.470195:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201497.470200:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9cdf831ecd40) has no exports 00000004:01000000:1.0:1788201497.470431:0:20812:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201497.470443:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721404 00000020:00000080:1.0:1788201497.470448:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf821de800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201497.470914:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbdf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788201497.471394:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788201497.471472:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821de800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788201497.471498:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201497.471508:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201497.471513:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9ce0c1504d40) has no exports 00000020:00000080:1.0:1788201497.471522:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213fd 00000020:00000080:1.0:1788201497.471529:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce08341f800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201497.473412:0:20812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201497.473422:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201497.473428:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788201497.473437:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201497.473440:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201497.477840:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201497.477867:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201497.477880:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213ef 00000020:00000080:1.0:1788201497.477953:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf821db800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201497.477985:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201497.477991:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201497.477997:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201497.478002:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9ce0c1500000) has no exports 00000020:00000080:1.0:1788201497.478012:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213e8 00000020:00000080:1.0:1788201497.478017:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf821d8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201497.478895:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce08341f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201497.478915:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce083419000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788201497.478923:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf821dd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201497.478926:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788201497.478932:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201497.479044:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821db800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201497.479049:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788201497.479093:0:20812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201497.479099:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201497.479104:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788201497.479113:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201497.479115:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201497.479161:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201497.479170:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788201497.479393:0:20812:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788201497.479403:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213da 00000020:00000080:1.0:1788201497.479411:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf821df000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201497.479417:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788201497.479421:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201497.479426:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201497.479429:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9ce0a64399c0) has no exports 00000020:00000080:1.0:1788201497.479436:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213d3 00000020:00000080:1.0:1788201497.479439:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0b94fe000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201497.479923:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf821da800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201497.479932:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf821de000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201497.479935:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821de000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788201497.479940:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201497.480004:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf821df000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788201497.480010:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b94fe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788201497.485883:0:20812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788201497.485910:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788201497.485915:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201497.485927:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201497.485999:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201497.486015:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201497.486051:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201497.486054:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201497.486062:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbdb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201497.486068:0:20812:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbdb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788201497.486088:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201497.486182:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0b94fb000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788201497.486191:0:37:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbd9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201497.486193:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbd9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788201497.486202:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201497.486559:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213a9 00000020:00000080:0.0:1788201497.486569:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbdc800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788201497.486577:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788201497.486583:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201497.486590:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201497.486595:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9cdf831e8000) has no exports 00000020:00000080:0.0:1788201497.486631:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201497.486635:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788201497.486640:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447213b0 00000020:00000080:0.0:1788201497.486644:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbda800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201497.486653:0:20812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0ba1d3800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788201497.486657:0:20812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0ba1d3800 3 00000020:01000004:0.0:1788201497.486660:0:20812:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0ba1d3800 from lustre-MDT0000 00000020:00000080:0.0:1788201497.486683:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201497.486686:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788201497.486688:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbdd800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788201497.486691:0:20812:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbdd800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788201497.486702:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788201497.486761:0:20812:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788201497.486767:0:20812:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788201497.486771:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788201497.486773:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201497.486785:0:20812:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201497.486793:0:20812:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9cdf8376e800 b50ecc63-79e7-4d40-95c3-4efbcef0f7e7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201497.486800:0:20812:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9cdf831eb380) has exports, disconnecting them 00000020:00080000:0.0:1788201497.486804:0:20812:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cdf8376e800), last request at 1788201406 00000020:00000080:0.0:1788201497.486823:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721355 00000020:00010000:0.0:1788201497.486827:0:20812:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9cdf8376e800: total 2 00000100:00080000:0.0:1788201497.486831:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9cdf8376f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201497.486854:0:20812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf8376e800): rc 0 00000020:00080000:0.0:1788201497.486859:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9cdf831eb380) has no exports 00000100:00100000:0.0:1788201497.486942:0:17234:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cdf8262aa00:17234] 1 exiting: rc = 0 00000100:00100000:0.0:1788201497.487054:0:17233:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ce0c1fd9c00:17233] 0 exiting: rc = 1 00000020:00000080:3.0:1788201497.487256:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbdc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788201497.487263:0:37:0:(genops.c:906:class_export_put()) final put ffff9ce0bbbdd000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788201497.487265:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbdd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788201497.487270:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788201497.487337:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bbbda800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788201497.490676:0:17228:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9cdf8376e800: total 0 00010000:00010000:2.0:1788201497.490699:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201497.491669:0:17228:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9cdf8376e800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788201497.492384:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367cc00/0xf9b71aee447215b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447215af expref: 14 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.493985:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255c00/0xf9b71aee44721482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4472147b expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494032:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855ba600/0xf9b71aee44721363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4472135c expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494043:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e1200/0xf9b71aee44721650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721649 expref: 11 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494061:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce080031e00/0xf9b71aee4472184f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721848 expref: 10 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494075:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44721474 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4472146d expref: 9 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494883:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf825e0200/0xf9b71aee447215e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee447215d9 expref: 8 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494903:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367d000/0xf9b71aee4472190c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721905 expref: 7 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494920:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855ba000/0xf9b71aee44721531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee4472152a expref: 6 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.494932:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367de00/0xf9b71aee4472191a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721913 expref: 5 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.495402:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83255a00/0xf9b71aee44721490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721489 expref: 4 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.495631:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf8367d800/0xf9b71aee44721928 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721921 expref: 3 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.495668:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bbe00/0xf9b71aee4472167a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf9b71aee44721673 expref: 2 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.495682:0:17228:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9cdf8376e800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788201497.496363:0:17228:0:(genops.c:906:class_export_put()) final put ffff9cdf8376e800/b50ecc63-79e7-4d40-95c3-4efbcef0f7e7 00010000:00010000:2.0:1788201497.496520:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201497.496524:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201497.496526:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201497.496641:0:17235:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cdf8231ae00:17235] 2 exiting: rc = 0 00000100:00100000:0.0:1788201497.496756:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496768:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496774:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496779:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496785:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496790:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496797:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496802:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496809:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496815:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496821:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.496826:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.497956:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.497974:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.497982:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.497988:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.497994:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498000:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498006:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498011:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498017:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498024:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498045:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498051:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498057:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498063:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498069:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498076:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498082:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498089:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498096:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498103:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498108:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498114:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498119:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498125:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498130:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498135:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498140:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498145:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498151:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498156:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498162:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498169:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498175:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498181:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498187:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498192:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498197:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498203:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498209:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498214:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498220:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498226:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498231:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498237:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498242:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498257:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498262:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498268:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498274:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498280:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498286:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201497.498291:0:20812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788201497.502769:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8376e800/b50ecc63-79e7-4d40-95c3-4efbcef0f7e7 for MGS 00000020:00000080:3.0:1788201497.502953:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf8376f800 for MGS 00000020:01000000:0.0:1788201497.504344:0:20812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf84199300 - data ffff9ce0abd4f1b0/ffff9ce084bab000 00000020:01000000:0.0:1788201497.504660:0:20812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf824890c0 - data ffff9ce0abccf870/ffff9cdf834d1400 00000020:00000080:0.0:1788201497.505826:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721339 00000020:00000080:0.0:1788201497.505840:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf84036000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201497.505899:0:20812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0ba1d3800 from MGS, refs=2 00000020:01000004:0.0:1788201497.505904:0:20812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0ba1d3800 2 00000020:01000004:0.0:1788201497.505908:0:20812:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0ba1d3800 from MGS 00000020:00000080:0.0:1788201497.505941:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201497.505950:0:20812:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788201497.505954:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf84032000/MGS 00000020:00000080:0.0:1788201497.505957:0:20812:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf84032000/MGS for MGS 00000020:01000000:0.0:1788201497.505967:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788201497.506046:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788201497.506050:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201497.506056:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201497.506064:0:20812:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cdf831fe000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201497.506071:0:20812:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9ce0bf453380) has exports, disconnecting them 00000020:00080000:0.0:1788201497.506076:0:20812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cdf831fe000), last request at 1788201406 00000020:00000080:0.0:1788201497.506081:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472143c 00000020:00080000:0.0:1788201497.506091:0:20812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf831fe000): rc 0 00000020:00000080:0.0:1788201497.506163:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf831fe000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788201497.506838:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf84036000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201497.507976:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf831fe000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788201497.510112:0:20812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788201497.510122:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201497.510128:0:20812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201497.510138:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201497.510196:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf459000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201497.514820:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201497.514838:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788201497.514846:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0b9491000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788201497.514851:0:20812:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9491000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788201497.514862:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788201497.514974:0:20812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0ba1d3800 1 00000020:00000080:1.0:1788201497.514982:0:20812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472132b 00000020:00000080:1.0:1788201497.514993:0:20812:0:(genops.c:906:class_export_put()) final put ffff9cdf84037800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788201497.515005:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788201497.515009:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201497.515015:0:20812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201497.515020:0:20812:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9ce0bf4519c0) has no exports 00000020:00000080:3.0:1788201497.515950:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf84037800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201497.552030:0:20812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201497.552049:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788201497.552057:0:20812:0:(genops.c:906:class_export_put()) final put ffff9ce0ba1d7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201497.552078:0:20812:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0ba1d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788201497.552094:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788201497.552728:0:20812:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce0ba1d3000 00000020:02000400:3.0:1788201497.552845:0:20812:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788201497.717963:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201497.717993:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681358080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201497.718091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.718179:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681358080 00000100:00100000:1.0:1788201497.718188:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681358080 00000100:00100000:1.0:1788201497.718255:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201497.718267:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681358080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201497.718377:0:18749:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788201497.718432:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681358080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.718439:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788201497.718662:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201497.718713:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681358080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201497.718885:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681358208:0@lo:400:kworker.0 00000400:00000100:1.0:1788201497.718913:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064681358208 offset 0 length 224: 4 00000100:00080000:3.0:1788201497.718959:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201497.718964:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201497.718968:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201497.718974:0:493:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1788201497.718979:0:493:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201497.718985:0:493:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce0870d7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201497.719011:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8333ce00 x1875064681358336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201497.719065:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201497.719071:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681358464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.719100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.719134:0:19309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681358464 00000100:00100000:1.0:1788201497.719138:0:19309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681358464 00000100:00100000:1.0:1788201497.719170:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201497.719185:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681358464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.719227:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681358464:12345-0@lo:400:kworker.0 Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.719233:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201497.719265:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681358464:0@lo:400:kworker.0 00000100:00080000:3.0:1788201497.719346:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201497.719350:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201497.719352:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201497.719357:0:493:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1788201497.719360:0:493:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201497.719364:0:493:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ce0a02e8000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201497.719380:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf680e00 x1875064681358592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201497.719390:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201497.719394:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201497.719396:0:493:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201497.719400:0:493:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1788201497.719402:0:493:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201497.719406:0:493:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cdf81986800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201497.719427:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c88e00 x1875064681358720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201497.719450:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201497.719454:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201497.719457:0:493:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201497.719460:0:493:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1788201497.719462:0:493:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201497.719466:0:493:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf826f1800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201497.719476:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c8ad80 x1875064681358976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201497.719512:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681358336:0@lo:38:kworker.0 00000100:00100000:3.0:1788201497.719545:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.719654:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681358848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.719693:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681358592:0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.719767:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.719790:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201497.719796:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681359104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.719823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.719851:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681358848 00000100:00100000:1.0:1788201497.719855:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681358848 00000100:00100000:1.0:1788201497.719890:0:19574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681359104 00000100:00100000:1.0:1788201497.719893:0:19574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681359104 00000100:00100000:1.0:1788201497.719915:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201497.719922:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681358848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.719961:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681358848:12345-0@lo:400:kworker.0 Request processed in 40us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.719968:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201497.719980:0:19574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201497.719986:0:19574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681359104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.720013:0:19574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681359104:12345-0@lo:400:kworker.0 Request processed in 27us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.720019:0:19574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788201497.720045:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788201497.720065:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c8b100 x1875064681359104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201497.720084:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681359104:0@lo:400:kworker.0 00010000:00080000:1.0:1788201497.720098:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0b6c89c00 x1875064681358848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201497.720107:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681358848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.720210:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.720227:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681358720:0@lo:38:kworker.0 00000100:00100000:3.0:1788201497.720248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.720261:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681358976:0@lo:38:kworker.0 00000100:00100000:3.0:1788201497.720358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.720389:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681358336 00000100:00100000:3.0:1788201497.720393:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681358336 00000100:00100000:3.0:1788201497.720415:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201497.720420:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681358336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201497.720439:0:17246:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201497.720685:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681358592 00000100:00100000:1.0:1788201497.720690:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681358592 00000100:00100000:1.0:1788201497.720709:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681358720 00000100:00100000:1.0:1788201497.720712:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681358720 00000100:00100000:1.0:1788201497.720719:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681358976 00000100:00100000:1.0:1788201497.720721:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681358976 00000100:00100000:1.0:1788201497.720732:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201497.720756:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681358592:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201497.720768:0:17240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201497.720809:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681358592:12345-0@lo:38:kworker.0 Request processed in 71us (599us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201497.720815:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201497.720827:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201497.720832:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681358720:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201497.720841:0:17240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201497.720866:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681358720:12345-0@lo:38:kworker.0 Request processed in 33us (617us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201497.720871:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201497.721350:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201497.721356:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681358976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201497.721376:0:17240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201497.721408:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681358976:12345-0@lo:38:kworker.0 Request processed in 51us (1050us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201497.721414:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788201497.721470:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201497.721475:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201497.721479:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681358592:0@lo:38:kworker.0 00000100:00080000:1.0:1788201497.721489:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201497.721492:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201497.721495:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681358720:0@lo:38:kworker.0 00000100:00080000:1.0:1788201497.721503:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201497.721506:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201497.721509:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681358976:0@lo:38:kworker.0 00000100:00100000:2.0:1788201497.743918:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681358336:12345-0@lo:38:kworker.0 Request processed in 23488us (24363us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201497.743937:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788201497.744568:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201497.744577:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201497.744582:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681358336:0@lo:38:kworker.0 00010000:00010000:2.0:1788201498.486521:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201499.511121:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201500.535993:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201501.558613:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201501.660040:0:21013:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788201501.666994:0:21013:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788201501.667059:0:21013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.667086:0:21013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.667095:0:21013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.667102:0:21013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.667131:0:21013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201501.667136:0:21013:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201501.667161:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201501.667166:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201501.667171:0:21013:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788201501.667176:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201501.667189:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201501.667202:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855baa00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201501.667207:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201501.667218:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201501.667227:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201501.667256:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201501.667259:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201501.667262:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201501.667313:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201501.667321:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788201501.667357:0:21013:0:(import.c:65:import_set_state_nolock()) ffff9ce0a02e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1788201501.667359:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201501.667372:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201501.667376:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201501.667380:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788201501.667385:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855baa00/0xf9b71aee4472152a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721531 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201501.667404:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201501.667406:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201501.667409:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201501.667437:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681359232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201501.667526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201501.667640:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681359232 00000100:00100000:1.0:1788201501.667649:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681359232 00000100:00100000:1.0:1788201501.667709:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201501.667719:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875064681359232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788201501.667728:0:17226:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201501 with bad export cookie 17993880446834971477 00010000:00010000:0.0:1788201501.671571:0:21013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671601:0:21013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671836:0:21013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671843:0:21013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671867:0:21013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201501.671874:0:21013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671892:0:21013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671898:0:21013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671905:0:21013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671921:0:21013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201501.671938:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201501.671944:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671950:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e0400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201501.671954:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.671967:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201501.671983:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201501.671988:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201501.671991:0:19639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788201501.672024:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672029:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201501.672069:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672301:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0400/0xf9b71aee44721489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721490 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672319:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201501.672323:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672329:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367ce00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201501.672332:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672340:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201501.672347:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201501.672353:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201501.672361:0:19639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788201501.672363:0:19639:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788201501.672379:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672384:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201501.672407:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672415:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf8367ce00/0xf9b71aee44721848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee4472184f expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672427:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201501.672429:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201501.672431:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201501.672443:0:21013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672451:0:21013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672458:0:21013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672465:0:21013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672476:0:21013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201501.672481:0:21013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672497:0:21013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672504:0:21013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672510:0:21013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672520:0:21013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788201501.672523:0:21013:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788201501.672525:0:21013:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1788201501.672553:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201501.672556:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672562:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201501.672564:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672570:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201501.672576:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201501.672594:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201501.672596:0:19639:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788201501.672598:0:19639:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788201501.672617:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788201501.672630:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672639:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201501.672649:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201501.672653:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681359488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201501.672659:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721921 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721928 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672671:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201501.672674:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672681:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf825e1800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201501.672684:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672692:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201501.672698:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201501.672704:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201501.672706:0:19639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788201501.672708:0:19639:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788201501.672723:0:19639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672729:0:19639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201501.672735:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201501.672779:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e1800/0xf9b71aee4472147b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf9b71aee44721482 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201501.672789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201501.672805:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201501.672808:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201501.672809:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201501.672825:0:21013:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788201501.672829:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788201501.672834:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201501.672840:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788201501.672848:0:21013:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9cdf8348a000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201501.672855:0:21013:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9ce0849bf800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201501.672861:0:21013:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9ce0c15019c0) has exports, disconnecting them 00000100:00100000:2.0:1788201501.672867:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681359616:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788201501.672867:0:21013:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cdf8348a000), last request at 1788201497 00000020:00000080:0.0:1788201501.672879:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447216a4 00000100:00080000:0.0:1788201501.672901:0:21013:0:(import.c:65:import_set_state_nolock()) ffff9cdf8348f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201501.672912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201501.672954:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201501.672969:0:21013:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf8348a000): rc 0 00000020:00000080:0.0:1788201501.672972:0:21013:0:(genops.c:906:class_export_put()) final put ffff9cdf8348a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788201501.672984:0:21013:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ce0849bf800), last request at 1788201497 00000020:00000080:0.0:1788201501.672987:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472160a 00000100:00080000:0.0:1788201501.672992:0:21013:0:(import.c:65:import_set_state_nolock()) ffff9ce0849bd000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201501.673002:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201501.673009:0:21013:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0849bf800): rc 0 00000020:00000080:0.0:1788201501.673011:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0849bf800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788201501.673018:0:21013:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc15181ccfae0 00000100:00080000:0.0:1788201501.673035:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201501.673050:0:21013:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9cdf8333c380 x1875064681356288/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201508 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201501.673060:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788201501.673898:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201501.673921:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788201501.673934:0:17225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788201501.676537:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681359488 00000100:00100000:2.0:1788201501.676553:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681359488 00000100:00100000:2.0:1788201501.676617:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788201501.676629:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681359616 00000100:00100000:2.0:1788201501.676632:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681359616 00000100:00080000:0.0:1788201501.677541:0:21013:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201501.677553:0:21013:0:(import.c:65:import_set_state_nolock()) ffff9ce0870d7800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1788201501.677722:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681359744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201501.677808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201501.677847:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681356288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201501.677871:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201501.677878:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681359360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201501.677903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201501.677930:0:21014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201501.677966:0:21014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875064681359488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788201501.677977:0:21014:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201501 with bad export cookie 17993880446834971477 00000100:00100000:2.0:1788201501.678019:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788201501.678030:0:17225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1788201501.678293:0:21014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875064681359488:12345-0@lo:103:ldlm_bl.0 Request processed in 329us (5509us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201501.678302:0:21014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788201501.678359:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201501.678364:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cdf83774000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788201501.678368:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788201501.679141:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681359744 00000100:00100000:0.0:1788201501.679150:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681359744 00000100:00100000:0.0:1788201501.679195:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681359360 00000100:00100000:0.0:1788201501.679199:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681359360 00000020:00000080:1.0:1788201501.679531:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf8348a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788201501.679612:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0849bf800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788201501.679639:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf8348f800 for lustre-MDT0001 00000020:00000080:1.0:1788201501.679644:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0849bd000 for lustre-MDT0001 00010000:00010000:1.0:1788201501.679663:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201501.680301:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201501.680314:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875064681359616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788201501.680324:0:17227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201501 with bad export cookie 17993880446834971477 00000100:00100000:0.0:1788201501.680402:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875064681359616:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (7495us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201501.680410:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201501.680432:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201501.680441:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875064681359744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788201501.680446:0:17227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201501 with bad export cookie 17993880446834971477 00000100:00100000:0.0:1788201501.680484:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875064681359744:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (2675us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201501.680507:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201501.680533:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201501.680541:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba262050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875064681359360:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201501.680548:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875064681359232:12345-0@lo:103:ldlm_bl.0 Request processed in 12824us (13019us total) trans 0 rc -107/-107 00010000:00020000:0.0:1788201501.680555:0:17227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788201501 with bad export cookie 17993880446834971477 00000100:00100000:1.0:1788201501.680567:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201501.680626:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba262050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875064681359360:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (2719us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201501.680635:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788201501.680705:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201501.681363:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201501.681370:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788201501.681486:0:21013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201501.681574:0:21013:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201501.681996:0:21013:0:(import.c:65:import_set_state_nolock()) ffff9ce0a026b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201501.682021:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201501.682024:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788201501.682035:0:21013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201501.682117:0:21013:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201501.682126:0:21013:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788201501.682245:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9ce0c15019c0) has no exports 00000100:00100000:1.0:1788201501.682816:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681359872:0@lo:9:umount.0 00000100:00100000:1.0:1788201501.682980:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201501.683030:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681360000:0@lo:9:umount.0 00000100:00100000:1.0:1788201501.683055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201501.683253:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681359872 00000100:00100000:3.0:1788201501.683263:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681359872 00000100:00100000:3.0:1788201501.683646:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681360000 00000100:00100000:3.0:1788201501.683651:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681360000 00000100:00080000:1.0:1788201501.683961:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201501.683967:0:17236:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201501.684061:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201501.684074:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875064681359872:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201501.684129:0:18746:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721634 00000100:00080000:3.0:1788201501.684140:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9cdf81985800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201501.684381:0:19309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201501.684392:0:19309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875064681360000:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201501.684408:0:19309:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447216c0 00000100:00080000:1.0:1788201501.684415:0:19309:0:(import.c:65:import_set_state_nolock()) ffff9cdf834e5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201501.684463:0:19309:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788201501.684666:0:19309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3643:x1875064681360000:12345-0@lo:9:umount.0 Request processed in 276us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201501.684675:0:19309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788201501.684777:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0bf443000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201501.684792:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201501.684794:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201501.684798:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681360000:0@lo:9:umount.0 00000001:00000004:3.0:1788201501.685299:0:18746:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788201501.685453:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1875064681359872:12345-0@lo:9:umount.0 Request processed in 1380us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201501.685461:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788201501.686266:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a026b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201501.687086:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201501.687092:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201501.687101:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681359872:0@lo:9:umount.0 00010000:00010000:3.0:1788201501.687808:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201501.690998:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201501.699695:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.102@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788201501.699703:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788201501.699718:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf8333e680 x1875064681358208/t0(0) o400->MGC192.168.203.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201501.699765:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba228000 x1875064681359232/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201517 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201501.699777:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba3b0a80 x1875064681359488/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201517 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201501.699786:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf82397b80 x1875064681359616/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201517 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201501.699794:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf694380 x1875064681359744/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201517 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201501.699803:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba3b1f80 x1875064681359360/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201517 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201501.700909:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9cdf83774000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788201501.701096:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681359744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201501.701113:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681359232:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788201501.701178:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788201501.701186:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788201501.701193:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788201501.701200:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cdf83774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201501.701234:0:3647:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1788201501.701247:0:3647:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff9cdf83774000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201501.701440:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681358208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201501.701486:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3644:1875064681359360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201501.705510:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836cb800 x1875064681360128/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201501.705596:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3643:1875064681360128:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:2.0:1788201501.705603:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681359616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201501.705612:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3647:1875064681359488:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1788201501.705663:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064681360128 offset 0 length 520: 4 00000020:00080000:2.0:1788201501.714241:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9ce0c15019c0) has no exports 00000020:01000000:3.0:1788201501.788495:0:21013:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ce088616ba0 - data ffff9cdf81c395e8/ffff9ce0bb60fc00 00000020:01000000:3.0:1788201501.788709:0:21013:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf82489c00 - data ffff9ce0abdb41b0/ffff9ce0a032f000 00000001:00000004:3.0:1788201501.808422:0:21013:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788201501.857924:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201501.857934:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201501.857942:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788201501.862916:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201501.862942:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788201501.862977:0:21013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201501.862981:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201501.863803:0:17981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201501.863810:0:17981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788201501.863879:0:17981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788201501.866166:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201501.866180:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788201501.866239:0:21013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201501.866242:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201501.866910:0:17983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201501.866917:0:17983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788201501.866928:0:17983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788201501.869033:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472149e 00000020:00000080:0.0:1788201501.869049:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0b3254000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788201501.870845:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3254000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788201501.871002:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214b3 00000020:00000080:0.0:1788201501.871014:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0b9491800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788201501.871118:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788201501.871125:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201501.871156:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201501.871162:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9ce0c1503380) has no exports 00000004:01000000:0.0:1788201501.871612:0:21013:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788201501.871639:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721507 00000020:00000080:0.0:1788201501.871646:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0b9736800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201501.872568:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9491800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788201501.872660:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788201501.872669:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201501.872679:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201501.872684:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9ce0bf454d40) has no exports 00000020:00000080:0.0:1788201501.872694:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721500 00000020:00000080:0.0:1788201501.872701:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0bf446800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788201501.873298:0:21013:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788201501.873304:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201501.873309:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788201501.873317:0:21013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201501.873320:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201501.873431:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201501.873441:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201501.873450:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214f2 00000020:00000080:0.0:1788201501.873456:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0bf443800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788201501.873461:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788201501.873467:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201501.873470:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201501.873472:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9ce0b9704d40) has no exports 00000020:00000080:0.0:1788201501.873478:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214e4 00000020:00000080:0.0:1788201501.873481:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0a026a800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788201501.873967:0:21013:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788201501.873971:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201501.873974:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788201501.873978:0:21013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201501.873991:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201501.874019:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201501.874024:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788201501.874040:0:21013:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788201501.874048:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214d6 00000020:00000080:0.0:1788201501.874054:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0870d2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788201501.874058:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788201501.874062:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201501.874065:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201501.874068:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9ce0a643b380) has no exports 00000020:00000080:0.0:1788201501.874072:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214cf 00000020:00000080:3.0:1788201501.874198:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9736800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788201501.874209:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf446800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201501.874223:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0bf443000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788201501.874228:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0bf442800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201501.874230:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf442800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788201501.874237:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201501.874353:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf443800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788201501.874359:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a026a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201501.874435:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a026b800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788201501.874443:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0889bd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201501.874445:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0889bd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788201501.874450:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201501.874482:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0870d2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788201501.874520:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0870d1800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788201501.878253:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0870d1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788201501.903435:0:21013:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788201501.903448:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201501.903454:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201501.903528:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201501.903650:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201501.903667:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201501.903699:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201501.903703:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201501.903710:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0a64ba800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201501.903716:0:21013:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a64ba800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788201501.903731:0:21013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201501.903972:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214ba 00000020:00000080:0.0:1788201501.903981:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0b9494000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788201501.904030:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0870d7800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788201501.904038:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0870d6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201501.904041:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0870d6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788201501.904048:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788201501.905358:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788201501.905441:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9494000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788201501.905535:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201501.905547:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201501.905552:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9ce0a6583380) has no exports 00000020:00000080:0.0:1788201501.907797:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201501.907821:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788201501.907831:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0a64bc800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788201501.907861:0:21013:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a64bc800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788201501.907873:0:21013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788201501.908116:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447214c1 00000020:00000080:0.0:1788201501.908125:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0b9493000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788201501.908147:0:21013:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0b3251800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788201501.908151:0:21013:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b3251800 2 00000020:01000004:0.0:1788201501.908155:0:21013:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0b3251800 from lustre-MDT0001 00000020:00000080:3.0:1788201501.908328:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b9493000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788201501.908481:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201501.908488:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788201501.908493:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0b3256800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788201501.908495:0:21013:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3256800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788201501.908503:0:21013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788201501.908538:0:21013:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788201501.908545:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788201501.908550:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201501.908555:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201501.908565:0:21013:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ce0a02e9800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201501.908572:0:21013:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9cdf821d3380) has exports, disconnecting them 00000020:00080000:0.0:1788201501.908587:0:21013:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ce0a02e9800), last request at 1788201420 00000020:00000080:0.0:1788201501.908593:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472153f 00000020:00080000:0.0:1788201501.908608:0:21013:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce0a02e9800): rc 0 00000020:00000080:0.0:1788201501.908614:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0a02e9800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201501.909668:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a02e9800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788201501.960866:0:21013:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788201501.960881:0:21013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201501.960888:0:21013:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201501.960900:0:21013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201501.961126:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201501.961140:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788201501.961148:0:21013:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b3251800 1 00000020:00000080:1.0:1788201501.961158:0:21013:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721466 00000020:00000080:1.0:1788201501.961179:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0bf440000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788201501.961186:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788201501.961193:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201501.961199:0:21013:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201501.961203:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9ce0b9703380) has no exports 00000020:00000080:3.0:1788201501.961504:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ce0a02e8000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201501.961513:0:493:0:(genops.c:906:class_export_put()) final put ffff9ce0a02eb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788201501.961517:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a02eb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788201501.961531:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788201501.961636:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf440000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201502.008251:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201502.008271:0:21013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788201502.008292:0:21013:0:(genops.c:906:class_export_put()) final put ffff9ce0b3250800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788201502.008298:0:21013:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0b3250800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788201502.008306:0:21013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788201502.009123:0:21013:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce0b3257000 00000020:01000000:3.0:1788201502.009187:0:21013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788201502.009192:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201502.009198:0:21013:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201502.009204:0:21013:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9ce0b97019c0) has no exports 00000100:00100000:3.0:1788201502.009305:0:17242:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9cdf836e6c00:17242] 2 exiting: rc = 0 00000100:00100000:0.0:1788201502.009521:0:17240:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9cdf836e7e00:17240] 0 exiting: rc = 1 00000100:00100000:1.0:1788201502.009769:0:17241:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9cdf836e6400:17241] 1 exiting: rc = 0 00000100:00100000:1.0:1788201502.009843:0:19574:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cdf81978e00:19574] 3 exiting: rc = 0 00000100:00100000:3.0:1788201502.010124:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010134:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010141:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010147:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010153:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010159:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010166:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010171:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010178:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010185:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010191:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010197:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010204:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010210:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010217:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010224:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010230:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010236:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010243:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010249:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010256:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010261:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010267:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010273:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010279:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010302:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010308:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010314:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010320:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010326:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010331:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010337:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010343:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010349:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010356:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010362:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010381:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010388:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010613:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010620:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010626:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010632:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010639:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010645:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010651:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010658:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010664:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010670:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010675:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010682:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010687:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010694:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010700:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010711:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010717:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010724:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010730:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010776:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010785:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010791:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010807:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010814:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010821:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.010828:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.020862:0:17243:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cdf836e6000:17243] 0 exiting: rc = 1 00000100:00100000:3.0:1788201502.021105:0:20381:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9ce0b6251600:20381] 2 exiting: rc = 0 00000100:00100000:0.0:1788201502.021683:0:17244:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ce09e11f800:17244] 1 exiting: rc = 0 00000100:00100000:1.0:1788201502.021888:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021900:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021909:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021915:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021943:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021949:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021955:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021961:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021966:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021973:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021979:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021984:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021990:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.021996:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022002:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022008:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022014:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022020:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022025:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022030:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022036:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022042:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022047:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022053:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022059:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022065:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022070:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022147:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022155:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022160:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022230:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022237:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022244:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022249:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022255:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022261:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022267:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022272:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022277:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022291:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022297:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022302:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022307:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022312:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022319:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022325:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022330:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022336:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022341:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022347:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022354:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022359:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022618:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022625:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022631:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022637:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022644:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022649:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022655:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022660:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022667:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022673:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022679:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.022686:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.024687:0:17245:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ce09e11ec00:17245] 0 exiting: rc = 1 00000100:00100000:0.0:1788201502.025166:0:17246:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ce09e11e000:17246] 1 exiting: rc = 0 00000100:00100000:1.0:1788201502.025423:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025435:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025442:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025448:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025454:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025471:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025478:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025485:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025491:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025513:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025520:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025528:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025534:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025558:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025567:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025585:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025594:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025601:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025612:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025619:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025627:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025633:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025640:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025647:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025653:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025679:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025687:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025693:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025701:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025708:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025714:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025720:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025727:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025769:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025779:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025786:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025793:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025816:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025824:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025831:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025839:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025846:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025853:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025859:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025879:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025886:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025893:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025900:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025907:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025931:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025941:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025951:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025961:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025967:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025977:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025985:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.025994:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.026001:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.026008:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.026015:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.026024:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.026032:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.026040:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.026055:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.048830:0:17247:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ce09e11fe00:17247] 0 exiting: rc = 1 00000100:00100000:0.0:1788201502.048830:0:17248:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ce09e11ee00:17248] 1 exiting: rc = 0 00000100:00100000:0.0:1788201502.049045:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049053:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049064:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049085:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049091:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049096:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049102:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049108:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049114:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049119:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049124:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049129:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049134:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049139:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049150:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049166:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049172:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049178:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049185:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049190:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049196:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049202:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049208:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049214:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049219:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049225:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049230:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049235:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049249:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049259:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049265:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049277:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049284:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049291:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049297:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049302:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049308:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049314:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049327:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049333:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049339:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049344:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049350:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049355:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049360:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049366:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049371:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049378:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049383:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049388:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049394:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049399:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049405:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049410:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049415:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049420:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049426:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049432:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049437:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049442:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049448:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049453:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049459:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.049464:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.050198:0:17250:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ce09e11ea00:17250] 1 exiting: rc = 0 00000100:00100000:0.0:1788201502.050377:0:17249:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ce09e11e800:17249] 0 exiting: rc = 1 00000100:00100000:0.0:1788201502.050434:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050442:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050448:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050455:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050460:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050465:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050471:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050477:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050556:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050562:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050568:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050582:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050589:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050595:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050601:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050608:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050613:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050620:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050626:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050632:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050637:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050642:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050647:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050652:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050658:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050662:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050668:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050674:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050681:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050687:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050692:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050698:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050703:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050714:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050720:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050725:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050731:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050764:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050770:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050776:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050782:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050789:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050796:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050814:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050820:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050825:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050830:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050920:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050929:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050934:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050940:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050945:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050950:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050956:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050962:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.050968:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051220:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051226:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051232:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051237:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051357:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051363:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051370:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.051376:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201502.052536:0:17251:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cdf82078200:17251] 0 exiting: rc = 1 00000100:00100000:0.0:1788201502.053178:0:17252:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cdf82078a00:17252] 1 exiting: rc = 0 00000100:00100000:1.0:1788201502.054712:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054724:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054731:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054791:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054799:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054805:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054812:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054818:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054824:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054829:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054834:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054840:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054845:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054851:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054858:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054885:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054890:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054895:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054900:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054905:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054910:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054915:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054922:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054927:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054932:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054938:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054944:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054949:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054954:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.054959:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055025:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055033:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055039:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055044:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055050:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055055:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055061:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055066:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055072:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055078:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055084:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055090:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055096:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055101:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055107:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055113:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055119:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055124:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055130:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055135:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055150:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055156:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055162:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055169:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055175:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055181:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055187:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055202:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055210:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055215:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055222:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055227:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055231:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.055238:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201502.058150:0:17254:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ce0b5ade600:17254] 1 exiting: rc = 0 00000100:00100000:0.0:1788201502.058450:0:17255:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ce0b5adfc00:17255] 2 exiting: rc = 0 00000100:00100000:3.0:1788201502.058675:0:17253:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ce0b5adfa00:17253] 0 exiting: rc = 1 00000100:00100000:1.0:1788201502.058820:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058831:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058838:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058845:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058852:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058859:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058865:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058872:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058879:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058887:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058894:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058901:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058908:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058914:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058922:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058928:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058935:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058942:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058949:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058955:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.058984:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059008:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059015:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059021:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059028:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059034:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059041:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059048:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059056:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059063:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059069:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059076:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059083:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059090:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059097:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059103:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059110:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059115:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059122:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059127:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059134:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059141:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059147:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059155:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059178:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059186:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059205:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059212:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059218:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059225:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059231:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059237:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059244:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059250:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059257:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059263:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059277:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059283:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059288:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059295:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059301:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059307:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059313:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201502.059331:0:21013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788201502.069992:0:21013:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201502.070204:0:21013:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788201502.070211:0:21013:0:(genops.c:906:class_export_put()) final put ffff9cdf83771800/MDS_uuid 00000020:00000080:0.0:1788201502.070327:0:21013:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf83771800/MDS_uuid for MDS 00000020:01000000:0.0:1788201502.070337:0:21013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788201502.070554:0:21013:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788201502.584542:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201502.837924:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201502.837938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201502.837942:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201502.837960:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201502.837965:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201502.837975:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1788201502.837982:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201502.837990:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cdf81986800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201502.838051:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf694380 x1875064681360256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201502.838124:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201502.838128:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201502.838129:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201502.838133:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1788201502.838136:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201502.838140:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf826f1800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201502.838154:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf694a80 x1875064681360512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201502.838200:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201502.838221:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681360384:0@lo:400:kworker.0 00000400:00000100:0.0:1788201502.838288:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681360384 offset 0 length 224: 4 00000100:00100000:0.0:1788201502.838360:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681360640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201502.838785:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681360256:0@lo:38:kworker.0 00000400:00000100:2.0:1788201502.838815:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681360256 offset 0 length 520: 4 00000100:00100000:2.0:1788201502.838832:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681360512:0@lo:38:kworker.0 00000400:00000100:2.0:1788201502.838849:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681360512 offset 0 length 520: 4 00000400:00000100:0.0:1788201502.838944:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681360640 offset 0 length 224: 4 00010000:00010000:2.0:1788201503.616038:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201504.631111:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201505.661697:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201505.783367:0:21217:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788201505.794974:0:21217:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788201505.795044:0:21217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201505.795061:0:21217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201505.795069:0:21217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201505.795077:0:21217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201505.795136:0:21217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201505.795143:0:21217:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201505.795175:0:21217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201505.795189:0:21217:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf694380 x1875064681360256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201505.795262:0:21217:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201505.795271:0:21217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201505.795279:0:21217:0:(import.c:65:import_set_state_nolock()) ffff9cdf81986800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788201505.795285:0:21217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201505.795290:0:21217:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf694380 x1875064681360256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201522 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201505.795326:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201505.795335:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201505.795344:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:3.0:1788201505.795348:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201505.795358:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201505.795365:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201505.795371:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201505.795374:0:17228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201505.795377:0:17228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201505.795392:0:17228:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:3.0:1788201505.795397:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201505.795404:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855bbc00/0xf9b71aee447215d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447215e0 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201505.795424:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201505.795426:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201505.795428:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201505.796123:0:21217:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201505.796153:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681360256:0@lo:38:kworker.0 00000100:00100000:2.0:1788201505.802056:0:21217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788201505.803027:0:21217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201505.803047:0:21217:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf697480 x1875064681360384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201518 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201505.803073:0:21217:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201505.803080:0:21217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788201505.803111:0:21217:0:(import.c:65:import_set_state_nolock()) ffff9cdf81987800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201505.803313:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681360384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201505.803432:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681360768:0@lo:39:umount.0 00000400:00000100:3.0:1788201505.803501:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681360768 offset 0 length 224: 4 00000100:00080000:2.0:1788201505.846011:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201505.846026:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201505.846031:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201505.846034:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201505.846161:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681360896:0@lo:400:kworker.0 00000400:00000100:0.0:1788201505.846236:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681360896 offset 0 length 224: 4 00010000:00010000:1.0:1788201506.679553:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201507.448529:0:18742:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201507.448552:0:18742:0:(genops.c:906:class_export_put()) final put ffff9cdf81984000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201507.449164:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81984000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201507.449241:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf81985800 for lustre-OST0000 00000001:00100000:0.0:1788201507.449869:0:19559:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201507.449883:0:19559:0:(genops.c:906:class_export_put()) final put ffff9cdf834e0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788201507.449947:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf834e0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788201507.449993:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf834e5800 for lustre-OST0001 00010000:00010000:0.0:1788201507.702570:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201507.893890:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201507.893904:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201507.893907:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201507.893912:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201507.894176:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681361024:0@lo:400:kworker.0 00000400:00000100:1.0:1788201507.894365:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681361024 offset 0 length 224: 4 00010000:00010000:3.0:1788201508.725888:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201509.751992:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201510.774156:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201511.800557:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201511.925920:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201501/real 1788201501] req@ffff9cdf836cb800 x1875064681360128/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201511 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201511.925967:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cdf836cb800 x1875064681360128/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201511 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201511.925995:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf83774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201511.926030:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788201511.926034:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3643:1875064681360128:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1788201511.926153:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201511.926160:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788201511.926164:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cdf83774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201511.926170:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 581 00000100:00080000:1.0:1788201511.926176:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.102@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201511.926185:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff9cdf83774000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201511.926403:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba22aa00 x1875064681361152/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201511.926435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201511.926439:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201511.926587:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201511.926603:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681361280:0@lo:400:kworker.0 00000400:00000100:2.0:1788201511.926670:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681361280 offset 0 length 224: 4 00000100:00100000:3.0:1788201511.926826:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3643:1875064681361152:0@lo:250:kworker.0 00000400:00000100:3.0:1788201511.926850:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064681361152 offset 0 length 520: 4 00010000:00010000:1.0:1788201512.823045:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201513.846478:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201514.870452:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201515.894139:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201516.021911:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201505/real 1788201505] req@ffff9cdf836cbb80 x1875064681360768/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201516.021957:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cdf836cbb80 x1875064681360768/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201516.022012:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf81987800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201516.022038:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681360768:0@lo:39:umount.0 00000100:00080000:2.0:1788201516.022824:0:21217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201516.022831:0:21217:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201516.022838:0:21217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201516.028857:0:21217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201516.028895:0:21217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201516.028904:0:21217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201516.028913:0:21217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201516.029475:0:21217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201516.029500:0:21217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201516.029511:0:21217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201516.029538:0:21217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201516.029546:0:21217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029586:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201516.029596:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029605:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb600 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201516.029610:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029620:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201516.029629:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201516.029637:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201516.029640:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788201516.029656:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:0.0:1788201516.029660:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029668:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855bb600/0xf9b71aee447215af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee447215b6 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029693:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201516.029696:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029715:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce080031800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201516.029719:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029726:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201516.029733:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201516.029882:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201516.029885:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788201516.029892:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:0.0:1788201516.029895:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201516.029904:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201516.029905:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201516.029908:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201516.030277:0:21217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201516.030284:0:21217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce080031800/0xf9b71aee44721913 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472191a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201516.030297:0:21217:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788201516.030305:0:21217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788201516.030308:0:21217:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788201516.030353:0:21217:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788201516.030359:0:21217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788201516.030366:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201516.030374:0:21217:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201516.030380:0:21217:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9cdf821d4d40) has no exports 00000020:00080000:2.0:1788201516.030410:0:21217:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9cdf821d4d40) has no exports 00010000:00010000:0.0:1788201516.031423:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788201516.035526:0:21217:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ce0ba00b480 - data ffff9ce0abce7a20/ffff9cdf826de000 00000020:01000000:2.0:1788201516.035723:0:21217:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf84199960 - data ffff9ce09845dca8/ffff9cdf835b6c00 00100000:10000000:0.0:1788201516.045999:0:21217:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788201516.060377:0:21217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447215c4 00000020:00000080:3.0:1788201516.060397:0:21217:0:(genops.c:906:class_export_put()) final put ffff9cdf834e3000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788201516.060422:0:21217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0a02eb000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788201516.060426:0:21217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0a02eb000 2 00000020:01000004:3.0:1788201516.060429:0:21217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0a02eb000 from lustre-OST0000 00000020:00000080:3.0:1788201516.060471:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201516.060493:0:21217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788201516.060497:0:21217:0:(genops.c:906:class_export_put()) final put ffff9cdf834e1800/lustre-OST0000_UUID 00000020:00000080:3.0:1788201516.060501:0:21217:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf834e1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788201516.060508:0:21217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:1.0:1788201516.060510:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf834e3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1788201516.060640:0:21217:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788201516.060647:0:21217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788201516.060652:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201516.060658:0:21217:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201516.061099:0:21217:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cdf81983800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201516.061108:0:21217:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff9ce0b25219c0) has exports, disconnecting them 00000020:00080000:1.0:1788201516.061115:0:21217:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cdf81983800), last request at 1788201435 00000020:00000080:1.0:1788201516.061119:0:21217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447215ee 00000020:00080000:1.0:1788201516.061135:0:21217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf81983800): rc 0 00000020:00000080:1.0:1788201516.061141:0:21217:0:(genops.c:906:class_export_put()) final put ffff9cdf81983800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201516.062488:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81983800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788201516.066882:0:21217:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788201516.066893:0:21217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201516.066899:0:21217:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201516.066909:0:21217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201516.067080:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201516.067091:0:21217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788201516.067099:0:21217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788201516.067103:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201516.067119:0:21217:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201516.067128:0:21217:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9cdf81985000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201516.067136:0:21217:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9ce0b2524d40) has exports, disconnecting them 00000020:00080000:2.0:1788201516.067141:0:21217:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9cdf81985000), last request at 1788201435 00000020:00000080:2.0:1788201516.067146:0:21217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721603 00000020:00080000:2.0:1788201516.067173:0:21217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf81985000): rc 0 00000020:00000080:2.0:1788201516.067178:0:21217:0:(genops.c:906:class_export_put()) final put ffff9cdf81985000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788201516.067956:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf81986800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201516.067968:0:37:0:(genops.c:906:class_export_put()) final put ffff9cdf83781000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788201516.067972:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf83781000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788201516.067983:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201516.068064:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81985000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788201516.068092:0:21217:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788201516.068096:0:21217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201516.068100:0:21217:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201516.068104:0:21217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201516.068125:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf81987800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788201516.068244:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201516.068251:0:21217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201516.068254:0:21217:0:(genops.c:906:class_export_put()) final put ffff9cdf81982800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788201516.068256:0:21217:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf81982800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788201516.068269:0:21217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788201516.068296:0:21217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0a02eb000 1 00000020:00000080:3.0:1788201516.068303:0:21217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee447215a1 00000020:00000080:3.0:1788201516.068309:0:21217:0:(genops.c:906:class_export_put()) final put ffff9ce0a03a4000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788201516.068317:0:21217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788201516.068325:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a03a4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201516.068333:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201516.068337:0:21217:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201516.068340:0:21217:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9cdf821d0000) has no exports 00000020:00000080:3.0:1788201516.121546:0:21217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201516.121560:0:21217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788201516.121565:0:21217:0:(genops.c:906:class_export_put()) final put ffff9ce0a02ed000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788201516.121570:0:21217:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a02ed000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788201516.121581:0:21217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788201516.121766:0:21217:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce0a02ec000 00000020:02000400:3.0:1788201516.121822:0:21217:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788201516.919993:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201517.173878:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201517.173889:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201517.173892:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201517.173906:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201517.174071:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201517.174086:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681361408:0@lo:400:kworker.0 00000400:00000100:1.0:1788201517.174143:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681361408 offset 0 length 224: 4 00010000:00010000:0.0:1788201517.942244:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788201518.198851:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201502/real 1788201502] req@ffff9ce0bf694700 x1875064681360640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201518.233376:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ce0bf694700 x1875064681360640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201518.233391:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9cdf819da000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201518.233396:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201518.249321:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788201518.249841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201518.249848:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201518.249851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201518.249854:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201518.249857:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201518.249860:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201518.249864:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cdf819da000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201518.249871:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1788201518.249880:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cdf819da000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201518.249925:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba22a680 x1875064681361536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201518.250575:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681361536:0@lo:38:kworker.0 00000400:00000100:3.0:1788201518.250643:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064681361536 offset 0 length 520: 4 00000100:00100000:3.0:1788201518.251490:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681360640:0@lo:400:kworker.0 00010000:00010000:0.0:1788201518.977379:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201519.701560:0:21419:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788201519.717165:0:21419:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788201519.717888:0:21419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.717905:0:21419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.717913:0:21419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.717921:0:21419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.717972:0:21419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201519.717979:0:21419:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788201519.718005:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201519.718016:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf694a80 x1875064681360512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.718037:0:21419:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788201519.718044:0:21419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201519.718049:0:21419:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788201519.718054:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201519.718057:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf694a80 x1875064681360512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201522 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.718065:0:21419:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201519.718068:0:21419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1788201519.718137:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681360512:0@lo:38:kworker.0 00000100:00080000:1.0:1788201519.719919:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201519.719933:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf836cb480 x1875064681360896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201521 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720002:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf836c8a80 x1875064681361024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201523 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720016:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba229f80 x1875064681361280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201527 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720025:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf695880 x1875064681361408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201533 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720033:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba22a680 x1875064681361536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720046:0:21419:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788201519.720050:0:21419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788201519.720055:0:21419:0:(import.c:65:import_set_state_nolock()) ffff9cdf819da000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788201519.720059:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201519.720062:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf836cb480 x1875064681360896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201521 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201519.720127:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681361280:0@lo:400:kworker.0 00010000:00010000:0.0:1788201519.720348:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201519.720357:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.720367:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201519.720371:0:19639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.720381:0:19639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201519.720388:0:19639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201519.720393:0:19639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201519.720395:0:19639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788201519.720398:0:19639:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788201519.720412:0:19639:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:0.0:1788201519.720416:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.720422:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0855ba800/0xf9b71aee44721673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472167a expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.720434:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201519.720436:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201519.720437:0:19639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201519.720501:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681360896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201519.720562:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cdf836c8a80 x1875064681361024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201523 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720571:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba229f80 x1875064681361280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201527 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720578:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0bf695880 x1875064681361408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201533 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720585:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba22a680 x1875064681361536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201528 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201519.720591:0:21419:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201519.720622:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681361024:0@lo:400:kworker.0 00000100:00100000:2.0:1788201519.720694:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681361536:0@lo:38:kworker.0 00000100:00100000:3.0:1788201519.720842:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875064681361408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201519.720886:0:21419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788201519.721999:0:21419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.722013:0:21419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.722020:0:21419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.722027:0:21419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.722090:0:21419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201519.722097:0:21419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.722104:0:21419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.722111:0:21419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201519.722117:0:21419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722145:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201519.722152:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722171:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf8367c400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201519.722175:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722183:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201519.722189:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201519.722194:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201519.722196:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788201519.722204:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:0.0:1788201519.722207:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722214:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf8367c400/0xf9b71aee44721649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee44721650 expref: -99 pid: 19558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722226:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201519.722229:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722234:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae800 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201519.722237:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722243:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201519.722329:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201519.722334:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201519.722336:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788201519.722341:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:0.0:1788201519.722344:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201519.722351:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201519.722353:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201519.722355:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201519.722407:0:21419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201519.722411:0:21419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae800/0xf9b71aee44721905 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee4472190c expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201519.722425:0:21419:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788201519.722435:0:21419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788201519.722438:0:21419:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788201519.722466:0:21419:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788201519.722471:0:21419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788201519.722475:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201519.722480:0:21419:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201519.722485:0:21419:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9ce0a643cd40) has no exports 00000020:00080000:1.0:1788201519.722507:0:21419:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9ce0a643cd40) has no exports 00000020:01000000:1.0:1788201519.724447:0:21419:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ce0ba00b300 - data ffff9ce0abce7d80/ffff9cdf826df800 00000020:01000000:1.0:1788201519.724612:0:21419:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cdf84199a20 - data ffff9cdf81c42ca8/ffff9ce08492a400 00010000:00010000:0.0:1788201519.728975:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788201519.737639:0:21419:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788201519.749360:0:21419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472165e 00000020:00000080:3.0:1788201519.749370:0:21419:0:(genops.c:906:class_export_put()) final put ffff9cdf831a8800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788201519.749389:0:21419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0849b8800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788201519.749397:0:21419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0849b8800 2 00000020:01000004:3.0:1788201519.749400:0:21419:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce0849b8800 from lustre-OST0001 00000020:00000080:1.0:1788201519.749412:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf831a8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788201519.749424:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201519.749432:0:21419:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788201519.749436:0:21419:0:(genops.c:906:class_export_put()) final put ffff9ce0bf445000/lustre-OST0001_UUID 00000020:00000080:3.0:1788201519.749438:0:21419:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0bf445000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788201519.749476:0:21419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788201519.749566:0:21419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b50ecc63-79e7-4d40-95c3-4efbcef0f7e7->MGS 00010000:00010000:3.0:1788201519.749583:0:21419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721474 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201519.749595:0:21419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721474 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201519.749602:0:21419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788201519.749604:0:21419:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788201519.749608:0:21419:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788201519.749622:0:21419:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:3.0:1788201519.749626:0:21419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf825e0600/0xf9b71aee4472146d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee44721474 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201519.749641:0:21419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201519.749659:0:21419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201519.749664:0:21419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201519.749667:0:21419:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788201519.749669:0:21419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788201519.749678:0:21419:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cdf83774000 00010000:00010000:3.0:1788201519.749682:0:21419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee4472135c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf9b71aee44721363 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201519.749698:0:21419:0:(import.c:65:import_set_state_nolock()) ffff9cdf83774000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788201519.749725:0:21419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788201519.749784:0:21419:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788201519.749786:0:21419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788201519.749790:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788201519.749799:0:21419:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce0ba22aa00 x1875064681361152/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788201526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788201519.749818:0:21419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788201519.749821:0:21419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788201519.749878:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b50ecc63-79e7-4d40-95c3-4efbcef0f7e7:3643:1875064681361152:0@lo:250:kworker.0 10000000:01000000:3.0:1788201519.749947:0:21419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788201519.749957:0:21419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721347 00000020:00000080:3.0:1788201519.749962:0:21419:0:(genops.c:906:class_export_put()) final put ffff9cdf83773800/b50ecc63-79e7-4d40-95c3-4efbcef0f7e7 00000020:01000000:3.0:1788201519.749969:0:21419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.102@tcp (flags='') 00000020:00000080:3.0:1788201519.749973:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201519.749977:0:21419:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201519.749980:0:21419:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9ce0b9700000) has no exports 00000020:00000080:1.0:1788201519.749991:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf83773800/b50ecc63-79e7-4d40-95c3-4efbcef0f7e7 for MGC192.168.203.102@tcp 10000000:01000000:0.0:1788201519.750075:0:17237:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788201519.750160:0:21419:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.102@tcp: client import never connected 00000100:00080000:3.0:1788201519.750163:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788201519.750165:0:21419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788201519.750167:0:21419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788201519.750174:0:21419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788201519.750209:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201519.750211:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf83774000 for MGC192.168.203.102@tcp 00000020:00000080:3.0:1788201519.750215:0:21419:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.102@tcp (uuid b50ecc63-79e7-4d40-95c3-4efbcef0f7e7) 00000020:00000080:1.0:1788201519.750218:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf83772000/b50ecc63-79e7-4d40-95c3-4efbcef0f7e7 00000020:01000000:3.0:1788201519.750220:0:21419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788201519.750220:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf83772000/b50ecc63-79e7-4d40-95c3-4efbcef0f7e7 for MGC192.168.203.102@tcp 00000020:00000080:3.0:1788201519.750223:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:01000000:1.0:1788201519.750224:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.102@tcp (b50ecc63-79e7-4d40-95c3-4efbcef0f7e7) 00000020:00000080:3.0:1788201519.750226:0:21419:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788201519.750231:0:21419:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cdf826f5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201519.750236:0:21419:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9ce0a65819c0) has exports, disconnecting them 00000020:00080000:3.0:1788201519.750240:0:21419:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cdf826f5800), last request at 1788201450 00000020:00000080:3.0:1788201519.750244:0:21419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721688 00000020:00080000:3.0:1788201519.750253:0:21419:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf826f5800): rc 0 00000020:00000080:3.0:1788201519.750256:0:21419:0:(genops.c:906:class_export_put()) final put ffff9cdf826f5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788201519.750949:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf826f5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788201519.763806:0:21419:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788201519.763815:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201519.763819:0:21419:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201519.763829:0:21419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201519.763996:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201519.764004:0:21419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788201519.764011:0:21419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788201519.764018:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201519.764022:0:21419:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201519.764031:0:21419:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9cdf819d9800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201519.764037:0:21419:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9ce0a6584d40) has exports, disconnecting them 00000020:00080000:0.0:1788201519.764041:0:21419:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9cdf819d9800), last request at 1788201450 00000020:00000080:0.0:1788201519.764045:0:21419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee4472169d 00000020:00080000:0.0:1788201519.764070:0:21419:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cdf819d9800): rc 0 00000020:00000080:0.0:1788201519.764076:0:21419:0:(genops.c:906:class_export_put()) final put ffff9cdf819d9800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788201519.764486:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf826f1800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788201519.764506:0:493:0:(genops.c:906:class_export_put()) final put ffff9cdf826f4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788201519.764509:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf826f4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788201519.764516:0:493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788201519.764584:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf819d9800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788201519.767790:0:21419:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788201519.767802:0:21419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201519.767806:0:21419:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201519.767817:0:21419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201519.767855:0:493:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cdf819da000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788201519.798165:0:19639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788201519.798327:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788201519.798402:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788201519.798542:0:17224:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ce0ba04ea00:17224] 1 exiting: rc = 0 00000100:00100000:3.0:1788201519.798708:0:17223:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ce0ba04fe00:17223] 0 exiting: rc = 1 00000100:00100000:1.0:1788201519.798790:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201519.799069:0:21015:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9ce0bf566800:21015] 4 exiting: rc = 0 00000100:00100000:0.0:1788201519.799080:0:17227:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ce082f8b800:17227] 2 exiting: rc = 0 00000100:00100000:2.0:1788201519.799100:0:17225:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ce0ba04e800:17225] 0 exiting: rc = 1 00000100:00100000:2.0:1788201519.799190:0:17226:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ce082f8aa00:17226] 1 exiting: rc = 0 00000100:00100000:3.0:1788201519.799801:0:21014:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ce0b622fc00:21014] 3 exiting: rc = 0 00000100:00100000:2.0:1788201519.799939:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799946:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799952:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799959:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799966:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799972:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799979:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799985:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799990:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.799995:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800000:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800005:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800011:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800016:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800021:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800026:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800032:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800052:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800058:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800063:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800068:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800073:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800078:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800083:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800089:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800097:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800102:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800107:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800113:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800118:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800123:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800128:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800134:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800140:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800145:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800150:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800156:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800162:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800167:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800173:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800178:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800184:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800188:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800194:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800199:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800204:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800209:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800215:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800220:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800225:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800230:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800235:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800249:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800254:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800260:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800265:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800270:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800275:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800280:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800285:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800291:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800296:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800301:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.800307:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788201519.802002:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201519.802023:0:21419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788201519.802389:0:21419:0:(genops.c:906:class_export_put()) final put ffff9cdf826f0800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788201519.802395:0:21419:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf826f0800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788201519.802402:0:21419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788201519.802471:0:21419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0849b8800 1 00000020:00000080:2.0:1788201519.802478:0:21419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf9b71aee44721642 00000020:00000080:2.0:1788201519.802484:0:21419:0:(genops.c:906:class_export_put()) final put ffff9cdf834e7800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788201519.802504:0:21419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788201519.802508:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201519.802513:0:21419:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201519.802517:0:21419:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9ce0a6580000) has no exports 00000020:00000080:1.0:1788201519.802624:0:493:0:(genops.c:865:class_export_destroy()) destroying export ffff9cdf834e7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788201519.859086:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201519.859100:0:21419:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788201519.859106:0:21419:0:(genops.c:906:class_export_put()) final put ffff9ce0a03f8000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788201519.859111:0:21419:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a03f8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788201519.859120:0:21419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788201519.859477:0:21419:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce0a03fd000 00000020:01000000:2.0:1788201519.859505:0:21419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788201519.859510:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201519.859514:0:21419:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201519.860638:0:21419:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9ce0b2520000) has no exports 00000020:00000080:2.0:1788201519.860674:0:21419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201519.860684:0:21419:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788201519.860688:0:21419:0:(genops.c:906:class_export_put()) final put ffff9ce0a03a5000/OSS_uuid 00000020:00000080:2.0:1788201519.860691:0:21419:0:(genops.c:865:class_export_destroy()) destroying export ffff9ce0a03a5000/OSS_uuid for OSS 00000020:01000000:2.0:1788201519.860696:0:21419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788201519.861677:0:18746:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ce084931200:18746] 0 exiting: rc = 1 00000100:00100000:0.0:1788201519.861809:0:18748:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ce084954400:18748] 2 exiting: rc = 0 00000100:00100000:2.0:1788201519.862705:0:18747:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ce084955600:18747] 1 exiting: rc = 0 00000100:00080000:1.0:1788201519.862948:0:17236:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788201519.862962:0:19309:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ce0a0316800:19309] 3 exiting: rc = 0 00000100:00100000:3.0:1788201519.863062:0:19636:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9cdf833e3e00:19636] 4 exiting: rc = 0 00000100:00100000:0.0:1788201519.863157:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863166:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863172:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863178:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863183:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863189:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863194:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863200:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863205:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863211:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863216:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863222:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863227:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863232:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863237:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863242:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863247:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863252:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863258:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863264:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863269:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863274:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863279:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863284:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863290:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863295:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863314:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863319:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863324:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863330:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863335:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863341:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863347:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863351:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863357:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863363:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863368:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863373:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863378:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863383:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863388:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863393:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863399:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863404:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863409:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863414:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863422:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863445:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863466:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863472:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863478:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863483:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863488:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863495:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863499:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863505:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863509:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863514:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863520:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863537:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863542:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863554:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863559:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.863565:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201519.864924:0:18749:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ce0b6d4e400:18749] 0 exiting: rc = 1 00000100:00100000:1.0:1788201519.865775:0:18750:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9cdf835e1200:18750] 1 exiting: rc = 0 00000100:00100000:1.0:1788201519.865829:0:20379:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9cdf830f0a00:20379] 2 exiting: rc = 0 00000100:00100000:2.0:1788201519.868989:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.868999:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869004:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869009:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869014:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869019:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869024:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869028:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869033:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869038:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869043:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869048:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869053:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869058:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869063:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869068:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869074:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869079:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869084:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869090:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869095:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869100:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869106:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869110:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869115:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869120:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869125:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869130:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869152:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869157:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869162:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869167:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869173:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869178:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869183:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869188:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869194:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869199:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869203:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869208:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869213:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869217:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869222:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869227:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869232:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869237:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869242:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869247:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869252:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869258:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869263:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869269:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869274:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869278:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869283:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869288:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869292:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869297:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869302:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869306:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869311:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869316:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869320:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.869334:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.871818:0:18751:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ce0a6595e00:18751] 0 exiting: rc = 1 00000100:00100000:3.0:1788201519.871841:0:18752:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ce0b6d4e200:18752] 1 exiting: rc = 0 00000100:00100000:1.0:1788201519.872096:0:18753:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ce08b1e2800:18753] 2 exiting: rc = 0 00000100:00100000:2.0:1788201519.872335:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872344:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872351:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872357:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872363:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872370:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872376:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872381:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872387:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872393:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872400:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872406:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872412:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872418:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872423:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872429:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872435:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872441:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872481:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872488:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872498:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872503:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872509:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872515:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872530:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872536:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872543:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872548:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872554:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872561:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872566:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872572:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872578:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872595:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872601:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872607:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872612:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872617:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872622:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872629:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872634:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872639:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872661:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872669:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872674:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872680:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872685:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872690:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872696:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872702:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872710:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872717:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872724:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872732:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872760:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872767:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872775:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872781:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872787:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872793:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872798:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872804:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872810:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.872815:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201519.884688:0:18754:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ce0b3145000:18754] 0 exiting: rc = 1 00000100:00100000:2.0:1788201519.886694:0:18755:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ce0b3144e00:18755] 1 exiting: rc = 0 00000100:00100000:0.0:1788201519.886911:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886918:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886922:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886928:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886932:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886936:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886942:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886947:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886952:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886957:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886962:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886966:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886971:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886977:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886982:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886987:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886992:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.886997:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887003:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887008:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887012:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887018:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887023:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887028:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887034:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887039:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887045:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887050:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887055:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887061:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887066:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887071:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887091:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887096:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887100:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887106:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887111:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887116:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887121:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887126:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887132:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887137:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887142:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887146:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887151:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887156:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887161:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887165:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887170:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887175:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887180:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887185:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887189:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887194:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887199:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887204:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887209:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887214:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887219:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887225:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887229:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887235:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887240:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201519.887245:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201519.889729:0:18757:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ce0a00f3c00:18757] 1 exiting: rc = 0 00000100:00100000:0.0:1788201519.891360:0:18756:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ce0a00f2600:18756] 0 exiting: rc = 1 00000100:00100000:2.0:1788201519.892606:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892616:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892622:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892643:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892650:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892670:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892676:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892682:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892688:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892695:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892701:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892706:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892712:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892718:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892725:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892731:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892765:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892788:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892796:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892801:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892807:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892814:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892819:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892825:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892830:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892837:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892843:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892848:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892854:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892873:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892880:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892885:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892890:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892896:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892901:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892905:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892911:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892916:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892928:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892934:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892940:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892958:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892965:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892970:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892976:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892982:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892987:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892992:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.892999:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893005:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893010:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893016:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893022:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893041:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893047:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893053:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893058:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893064:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893068:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893073:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893078:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893084:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893089:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201519.893100:0:21419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788201519.912668:0:21419:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788201538.449623:0:22182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788201549.781598:0:22782:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201549.781604:0:22782:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788201549.781605:0:22782:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788201549.791149:0:22782:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0b62a4800 00000020:01000004:2.0:1788201549.791217:0:22782:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788201549.791226:0:22782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788201549.791252:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ce0b2523380) 00000020:00000080:2.0:1788201549.791267:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788201549.924771:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201549.933798:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788201549.942447:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788201549.946397:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788201549.947135:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788201549.948810:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788201549.949500:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788201549.949976:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788201549.953802:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788201549.954717:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.955472:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.955816:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.956153:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.956499:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.957778:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.958334:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.958561:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.960293:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.960802:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.961401:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.961723:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.962521:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.963214:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.963489:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.964207:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.968521:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.971447:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.973121:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.975264:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.976708:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.978707:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.980481:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.981511:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788201549.982215:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788201549.982896:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788201549.983502:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788201549.983859:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788201549.984420:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788201549.984735:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788201549.985298:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788201549.985493:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788201549.985728:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788201549.990308:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788201549.990856:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788201549.991452:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788201549.991791:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788201550.001904:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788201550.012272:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788201550.014165:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788201550.016587:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788201550.020352:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788201550.024316:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788201550.025284:0:22782:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1788201550.026509:0:22782:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788201550.026845:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788201550.026856:0:22782:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788201550.026871:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721bba 00000020:01000004:0.0:1788201550.026880:0:22782:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788201550.026887:0:22782:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788201550.026893:0:22782:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0b62a4800 from MGS 00000020:01000004:0.0:1788201550.026897:0:22782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788201550.026910:0:22782:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ce0a6583380) 00000020:00000080:0.0:1788201550.026931:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788201550.027012:0:22782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b62a4800 from MGS, refs=2 00080000:01000000:0.0:1788201550.027017:0:22782:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788201550.027023:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721bc8 00000100:00100000:0.0:1788201550.027144:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788201550.027298:0:22782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788201550.027305:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788201550.033203:0:22782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788201550.033220:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788201550.036655:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201550.037334:0:22782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788201550.037340:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788201550.047047:0:22782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788201550.047059:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788201550.050921:0:22782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788201550.050942:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788201550.058594:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201550.058599:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201550.058601:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201550.062989:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201550.062997:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201550.063000:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201550.064234:0:22782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788201550.066839:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788201550.080846:0:22782:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788201550.091276:0:22794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788201550.091397:0:22782:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788201550.091485:0:22782:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201550.092373:0:22782:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788201550.096132:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201550.096316:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788201550.096323:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788201550.099280:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788201550.099300:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788201550.099851:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788201550.099860:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788201550.113680:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788201550.113704:0:22782:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.102@tcp' 00000020:01000004:0.0:1788201550.113706:0:22782:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788201550.113768:0:22782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.102@tcp (typ=mgc) 00000020:00000080:0.0:1788201550.113781:0:22782:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.102@tcp (ffff9ce0a6580000) 00000020:00000080:0.0:1788201550.113798:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788201550.113881:0:22782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf84031800@MGC192.168.203.102@tcp: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201550.114026:0:22782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.102@tcp-0 is initialized 00000040:01000000:0.0:1788201550.114031:0:22782:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788201550.114483:0:22799:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788201550.114904:0:22800:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788201550.114969:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.102@tcp (uuid e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a) 00000020:00000080:2.0:1788201550.114987:0:22782:0:(genops.c:1406:class_connect()) connect: client e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a, cookie 0xf9b71aee44721bd6 00000100:00080000:2.0:1788201550.114997:0:22782:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201550.115003:0:22782:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff9cdf84031800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201550.115035:0:22782:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836c9500 x1875064681361664/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201550.115065:0:22782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a->MGS 00000020:01000004:2.0:1788201550.115089:0:22782:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788201550.115094:0:22782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788201550.115104:0:22782:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ce0b2520000) 00000020:00000080:2.0:1788201550.115112:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788201550.120890:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3643:1875064681361664:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788201550.120958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201550.123091:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681361664 00000100:00100000:3.0:1788201550.123105:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681361664 00000100:00100000:3.0:1788201550.123150:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201550.123158:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce088958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875064681361664:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788201550.123200:0:22796:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a@0@lo t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:3.0:1788201550.123236:0:22796:0:(genops.c:1406:class_connect()) connect: client e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a, cookie 0xf9b71aee44721be4 00000100:00080000:3.0:1788201550.123378:0:22796:0:(import.c:65:import_set_state_nolock()) ffff9ce0b62a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201550.123478:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce088958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+5:3643:x1875064681361664:12345-0@lo:250:mount.lustre.0 Request processed in 318us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201550.123486:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201550.123541:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788201550.123550:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.102@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201550.123558:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201550.123562:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201550.123566:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf84031800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201550.123568:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201550.123575:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201550.123580:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3643:1875064681361664:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788201550.129833:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201550.130015:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201550.130021:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788201550.138124:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201550.138139:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788201550.138640:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201550.138647:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788201550.145264:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201550.145411:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788201550.145417:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788201550.146103:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788201550.146110:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788201550.233116:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201550.233321:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788201550.233328:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788201550.244470:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788201550.244487:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788201550.246353:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201550.246541:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788201550.246547:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788201550.248312:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201550.248322:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788201550.251656:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201550.252151:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788201550.252157:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788201550.265887:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201550.265924:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788201550.267363:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201550.267727:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788201550.267733:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788201550.268547:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201550.268555:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788201550.342074:0:22782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201550.342280:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788201550.342287:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788201550.348568:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201550.348590:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788201550.357683:0:22782:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201550.357696:0:22782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788201550.359154:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788201550.359194:0:22782:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788201550.359201:0:22782:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201550.359327:0:22782:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201550.359362:0:22782:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788201550.359366:0:22782:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201550.359368:0:22782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201550.359369:0:22782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201550.359371:0:22782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201550.359372:0:22782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201550.359374:0:22782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201550.359375:0:22782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201550.359376:0:22782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201550.359378:0:22782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201550.359380:0:22782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201550.359382:0:22782:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788201550.359385:0:22782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201550.359386:0:22782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201550.359388:0:22782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201550.359389:0:22782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201550.359390:0:22782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201550.359391:0:22782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201550.359392:0:22782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201550.359393:0:22782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201550.359394:0:22782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201550.359395:0:22782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201550.359426:0:22782:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201550.359447:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681361792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201550.360380:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.360480:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201550.368951:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681361792 00000100:00100000:1.0:1788201550.368967:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681361792 00000100:00100000:1.0:1788201550.369037:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201550.369045:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce088959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+5:22782:x1875064681361792:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201550.369107:0:22798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201550.369110:0:22798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788201550.369114:0:22798:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788201550.369592:0:22819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788201550.371938:0:22798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788201550.374343:0:22820:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788201550.374349:0:22820:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788201550.374352:0:22820:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788201550.374355:0:22820:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788201550.374610:0:22820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788201550.374977:0:22798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201550.374987:0:22798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788201550.383148:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce088959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+5:22782:x1875064681361792:12345-0@lo:253:mount.lustre.0 Request processed in 14092us (22759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.383174:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201550.383359:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681361792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201550.383375:0:22782:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788201550.383378:0:22782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201550.383380:0:22782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201550.383381:0:22782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201550.383382:0:22782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201550.383383:0:22782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201550.383384:0:22782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201550.383386:0:22782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201550.383387:0:22782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201550.383389:0:22782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201550.383390:0:22782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201550.383412:0:22782:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0b62a4800 from lustre-MDT0000 10000000:01000000:1.0:1788201550.383443:0:22782:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788201550.383445:0:22782:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201550.383450:0:22782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ce0a6580000 10000000:01000000:1.0:1788201550.383466:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201550.383473:0:22782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce0a6580000 from 1 10000000:01000000:1.0:1788201550.383477:0:22782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201550.383514:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.383526:0:22782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.383536:0:22782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.383556:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681361920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201550.383592:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.383630:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.383965:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681361920 00000100:00100000:0.0:1788201550.383977:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681361920 00000100:00100000:0.0:1788201550.384021:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201550.384039:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+5:22782:x1875064681361920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201550.384053:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201550.384067:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83296e00/0xf9b71aee44721bf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721beb expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201550.384088:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83296e00/0xf9b71aee44721bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721beb expref: 6 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201550.384097:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83296e00/0xf9b71aee44721bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721beb expref: 6 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201550.384106:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83296e00, rc 0) 00000100:00100000:0.0:1788201550.384329:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+6:22782:x1875064681361920:12345-0@lo:101:mount.lustre.0 Request processed in 300us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.384336:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201550.385349:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681361920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201550.385370:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.385381:0:22782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.385455:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201550.385492:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.385529:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.387052:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681362048 00000100:00100000:0.0:1788201550.387062:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681362048 00000100:00100000:0.0:1788201550.387127:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201550.387136:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+6:22782:x1875064681362048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201550.387425:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+6:22782:x1875064681362048:12345-0@lo:501:mount.lustre.0 Request processed in 289us (1930us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201550.387432:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201550.387530:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362048:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788201550.387574:0:22782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201550.387594:0:22782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.387617:0:22782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201550.387625:0:22782:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0b62a4800 10000000:01000000:1.0:1788201550.387630:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201550.387635:0:22782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce0b62a4800 10000000:01000000:1.0:1788201550.387637:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201550.387640:0:22782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ce0b62a4800 from 1 10000000:01000000:1.0:1788201550.387642:0:22782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201550.387670:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254400/0xf9b71aee44721bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.387679:0:22782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254400/0xf9b71aee44721bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.387688:0:22782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254400/0xf9b71aee44721bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.387705:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201550.387777:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.387804:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201550.387868:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681362176 00000100:00100000:2.0:1788201550.387873:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681362176 00000100:00100000:2.0:1788201550.387906:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201550.387913:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+6:22782:x1875064681362176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201550.387923:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201550.387936:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03ae200/0xf9b71aee44721c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721bf9 expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.387956:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03ae200/0xf9b71aee44721c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721bf9 expref: 7 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.387964:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03ae200/0xf9b71aee44721c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721bf9 expref: 7 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.387972:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03ae200, rc 0) 00000100:00100000:2.0:1788201550.388002:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+7:22782:x1875064681362176:12345-0@lo:101:mount.lustre.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201550.388008:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201550.388315:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201550.388328:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254400/0xf9b71aee44721bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721c00 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.388336:0:22782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254400/0xf9b71aee44721bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721c00 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201550.388359:0:22782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788201550.388363:0:22782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254400/0xf9b71aee44721bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721c00 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.388370:0:22782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254400/0xf9b71aee44721bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721c00 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201550.388376:0:22782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201550.388380:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201550.388385:0:22782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce0b62a4800 10000000:01000000:1.0:1788201550.388388:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201550.388390:0:22782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788201550.388392:0:22782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201550.388406:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255600/0xf9b71aee44721c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.388412:0:22782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255600/0xf9b71aee44721c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.388420:0:22782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255600/0xf9b71aee44721c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.388433:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201550.388460:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.388481:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201550.388712:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681362304 00000100:00100000:2.0:1788201550.388717:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681362304 00000100:00100000:2.0:1788201550.388773:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201550.388781:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+7:22782:x1875064681362304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201550.388788:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201550.388796:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03afe00/0xf9b71aee44721c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721c07 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.388820:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03afe00/0xf9b71aee44721c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721c07 expref: 8 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.388828:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03afe00/0xf9b71aee44721c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721c07 expref: 8 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.388834:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03afe00, rc 0) 00000100:00100000:2.0:1788201550.388865:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+8:22782:x1875064681362304:12345-0@lo:101:mount.lustre.0 Request processed in 86us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201550.388872:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201550.389007:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201550.389018:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255600/0xf9b71aee44721c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721c0e expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.389044:0:22782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255600/0xf9b71aee44721c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721c0e expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.389096:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201550.389123:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.389142:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.389320:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681362432 00000100:00100000:0.0:1788201550.389325:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681362432 00000100:00100000:0.0:1788201550.389358:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201550.389365:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+8:22782:x1875064681362432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201550.389494:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22782:x1875064681362432:12345-0@lo:501:mount.lustre.0 Request processed in 128us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.389500:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201550.390248:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201550.390290:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201550.390341:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.390363:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201550.390380:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681362560 00000100:00100000:1.0:1788201550.390385:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681362560 00000100:00100000:1.0:1788201550.390423:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201550.390431:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22782:x1875064681362560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201550.391333:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22782:x1875064681362560:12345-0@lo:503:mount.lustre.0 Request processed in 899us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.391342:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201550.391789:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681362560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201550.392498:0:22821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22821:1875064681362688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.392550:0:22821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201550.392627:0:22821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9631c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201550.397623:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681362688 00000100:00100000:2.0:1788201550.397637:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681362688 00000100:00100000:3.0:1788201550.397793:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201550.397804:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22821:x1875064681362688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201550.399148:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22821:x1875064681362688:12345-0@lo:502:llog_process_th.0 Request processed in 1341us (6593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201550.399158:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201550.399394:0:22821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22821:1875064681362688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201550.399429:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201550.399441:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.399444:0:22821:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201550.399448:0:22821:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788201550.399452:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201550.399465:0:22821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ce0a6584d40) 00000020:00000080:0.0:1788201550.399482:0:22821:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788201550.399488:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201550.399564:0:22821:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201550.399571:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721c1c 00000020:00000080:0.0:1788201550.399961:0:22821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788201550.399966:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201550.399969:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.399970:0:22821:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201550.399973:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201550.399976:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.399977:0:22821:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788201550.399980:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201550.399987:0:22821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ce0a65819c0) 00000020:00000080:0.0:1788201550.399997:0:22821:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788201550.400009:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201550.400011:0:22821:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788201550.400014:0:22821:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788201550.400021:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201550.403863:0:22821:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b62a4800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788201550.403889:0:22821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cdf831eb380) 00000020:00000080:0.0:1788201550.403905:0:22821:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788201550.403968:0:22821:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201550.403974:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721c31 00000020:00000080:0.0:1788201550.404334:0:22821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788201550.404342:0:22821:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201550.404347:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf9b71aee44721c38 00080000:01000000:0.0:1788201550.404353:0:22821:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788201550.404356:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721c3f 00010000:00010000:1.0:1788201550.576105:0:22821:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788201550.578923:0:22821:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1788201550.582166:0:22821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788201550.585984:0:22821:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ce0a6438000) 00000020:00000080:1.0:1788201550.586009:0:22821:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788201550.588026:0:22821:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788201550.588040:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721c4d 00000020:00000080:1.0:1788201550.591804:0:22821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201550.604083:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf9b71aee44721c54 00000020:00000080:2.0:1788201550.604975:0:22821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788201550.604987:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.604994:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.604996:0:22821:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788201550.605000:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201550.605002:0:22821:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788201550.605004:0:22821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201550.605005:0:22821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201550.605006:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201550.605009:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.605010:0:22821:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201550.605012:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201550.605016:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.605017:0:22821:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788201550.605021:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201550.605072:0:22821:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201550.605087:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.605090:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.605096:0:22821:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788201550.605099:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201550.605102:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.605104:0:22821:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788201550.605107:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201550.605111:0:22821:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:2.0:1788201550.605137:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201550.605150:0:22821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ce0b2524d40) 00000020:00000080:2.0:1788201550.605943:0:22821:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788201550.605956:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201550.606059:0:22821:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788201550.606066:0:22821:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788201550.606073:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721c62 00010000:00080000:2.0:1788201550.606109:0:22821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0b9734000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201550.618571:0:22821:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788201550.619213:0:22821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201550.619226:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201550.619270:0:22821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201550.619291:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721c69 00000100:00080000:2.0:1788201550.619302:0:22821:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201550.619308:0:22821:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b9734000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201550.619345:0:22821:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836c8380 x1875064681362816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201550.619367:0:22821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788201550.619412:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.619416:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.619418:0:22821:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788201550.619421:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201550.619423:0:22821:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788201550.619425:0:22821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201550.619426:0:22821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201550.619434:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201550.619436:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.619438:0:22821:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201550.619440:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201550.619445:0:22821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201550.619449:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.619450:0:22821:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201550.619454:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201550.619457:0:22821:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:2.0:1788201550.619480:0:22821:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201550.619483:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201550.619495:0:22821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ce0b25219c0) 00000020:00000080:2.0:1788201550.619507:0:22821:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788201550.619511:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201550.619575:0:22821:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788201550.619581:0:22821:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788201550.619588:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721c77 00010000:00080000:2.0:1788201550.619617:0:22821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0a5be9000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201550.619839:0:22821:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788201550.620082:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681362816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201550.620144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.620252:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681362816 00000100:00100000:2.0:1788201550.620258:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681362816 00000100:00100000:2.0:1788201550.620295:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201550.620303:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681362816:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788201550.620320:0:22808:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201550.659365:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681362816:12345-0@lo:38:llog_process_th.0 Request processed in 39054us (39212us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201550.659380:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788201550.663569:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201550.663583:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201550.663600:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681362816:0@lo:38:llog_process_th.0 00000040:01000000:3.0:1788201550.677341:0:22821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201550.678398:0:22821:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788201550.681725:0:22821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201550.682263:0:22821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788201550.687392:0:22821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788201550.689485:0:22827:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788201550.689492:0:22827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788201550.691131:0:22821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201550.691147:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201550.691185:0:22821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201550.691203:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721c7e 00000100:00080000:2.0:1788201550.691214:0:22821:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201550.691221:0:22821:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce0a5be9000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201550.691263:0:22821:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836c8380 x1875064681362944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201550.691293:0:22821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788201550.691393:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681362944:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788201550.691488:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681362944 offset 0 length 520: 4 00000020:01000000:2.0:1788201550.691604:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.691608:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.691610:0:22821:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788201550.691612:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201550.691615:0:22821:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788201550.691617:0:22821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201550.691619:0:22821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201550.691620:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201550.691622:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.691623:0:22821:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201550.691626:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201550.691629:0:22821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201550.691633:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.691634:0:22821:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788201550.691636:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201550.691640:0:22821:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:2.0:1788201550.691659:0:22821:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201550.691662:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201550.691679:0:22821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ce0bf454d40) 00000020:00000080:2.0:1788201550.691690:0:22821:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788201550.691695:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201550.691798:0:22821:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788201550.691804:0:22821:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788201550.691810:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf9b71aee44721c8c 00010000:00080000:2.0:1788201550.691847:0:22821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0a1aa3800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201550.692042:0:22821:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788201550.692108:0:22821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201550.692123:0:22821:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788201550.699381:0:22821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201550.699898:0:22821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788201550.706399:0:22821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788201550.707252:0:22829:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788201550.707257:0:22829:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788201550.709511:0:22821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201550.709525:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201550.709570:0:22821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201550.710054:0:22821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721c93 00000100:00080000:2.0:1788201550.710067:0:22821:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201550.710073:0:22821:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce0a1aa3800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201550.716384:0:22821:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf696300 x1875064681363072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201550.716424:0:22821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788201550.716544:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681363072:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788201550.716614:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681363072 offset 0 length 520: 4 00000100:00080000:2.0:1788201550.717041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201550.717045:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201550.717049:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201550.717054:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 630 00000100:00080000:2.0:1788201550.717059:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201550.717065:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b9734000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201550.717082:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836c9f80 x1875064681363328/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201550.717098:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201550.717102:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201550.717127:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681363328:0@lo:38:kworker.0 00000100:00100000:2.0:1788201550.717162:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.717209:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681363328 00000100:00100000:2.0:1788201550.717216:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681363328 00000100:00100000:2.0:1788201550.717255:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201550.717262:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681363328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201550.717280:0:22809:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201550.717320:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681363328:12345-0@lo:38:kworker.0 Request processed in 57us (157us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201550.717327:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788201550.717360:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201550.717365:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201550.717368:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681363328:0@lo:38:kworker.0 00000100:00100000:3.0:1788201550.717900:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681363200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201550.717939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788201550.718313:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201550.718320:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.718323:0:22821:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788201550.718326:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201550.718331:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.718332:0:22821:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201550.718334:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201550.718336:0:22821:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201550.718338:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201550.718340:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.718342:0:22821:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788201550.718344:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201550.718346:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.718347:0:22821:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201550.718363:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788201550.718395:0:22821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22821:1875064681363456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.718830:0:22821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201550.718863:0:22821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201550.719078:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681363200 00000100:00100000:1.0:1788201550.719085:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681363200 00000100:00100000:1.0:1788201550.719128:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681363456 00000100:00100000:1.0:1788201550.719132:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681363456 00000100:00100000:1.0:1788201550.719148:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201550.719155:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+10:3647:x1875064681363200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201550.719213:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+10:3647:x1875064681363200:12345-0@lo:400:kworker.0 Request processed in 58us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.719221:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201550.719256:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201550.719264:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22821:x1875064681363456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201550.719373:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22821:x1875064681363456:12345-0@lo:502:llog_process_th.0 Request processed in 109us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.719380:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201550.719441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681363200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201550.720270:0:22821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22821:1875064681363456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201550.720302:0:22821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201550.720309:0:22821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201550.720312:0:22821:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201550.720315:0:22821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788201550.720711:0:22782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788201550.720779:0:22782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788201550.720804:0:22782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255600/0xf9b71aee44721c07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721c0e expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.720817:0:22782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255600/0xf9b71aee44721c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721c0e expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201550.720825:0:22782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b62a4800 from 1 10000000:01000000:1.0:1788201550.720837:0:22782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201550.720873:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.720882:0:22782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.720891:0:22782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.720913:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201550.720962:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.720996:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0812543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201550.721076:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681363584 00000100:00100000:3.0:1788201550.721082:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681363584 00000100:00100000:3.0:1788201550.721128:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201550.721139:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+9:22782:x1875064681363584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201550.721152:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201550.721168:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721c9a expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.721190:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 10 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.721203:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 10 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.721212:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75a00, rc 0) 00000100:00100000:3.0:1788201550.721262:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+10:22782:x1875064681363584:12345-0@lo:101:mount.lustre.0 Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201550.721269:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201550.721855:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201550.721870:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.721879:0:22782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.723328:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363712:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788201550.723395:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.723493:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0812543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.725348:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681363712 00000100:00100000:0.0:1788201550.725360:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681363712 00000100:00100000:0.0:1788201550.725925:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201550.725936:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+10:22782:x1875064681363712:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788201550.725964:0:22797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788201550.725970:0:22797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788201550.726368:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+10:22782:x1875064681363712:12345-0@lo:256:mount.lustre.0 Request processed in 433us (2971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.726375:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201550.732068:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363712:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788201550.732924:0:22782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201550.733050:0:22782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.733063:0:22782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201550.733072:0:22782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b62a4800 from 1 10000000:01000000:2.0:1788201550.733075:0:22782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201550.733120:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.733129:0:22782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.733194:0:22782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201550.733217:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201550.733292:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.733376:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a0800a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201550.738257:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681363840 00000100:00100000:1.0:1788201550.738271:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681363840 00000100:00100000:1.0:1788201550.738332:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201550.738342:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+10:22782:x1875064681363840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201550.738359:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201550.738394:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721ca8 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.738857:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.738871:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.738880:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254000, rc 0) 00000100:00100000:1.0:1788201550.738964:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22782:x1875064681363840:12345-0@lo:101:mount.lustre.0 Request processed in 623us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.738972:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201550.739092:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201550.739109:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.739119:0:22782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201550.739194:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201550.739227:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.739271:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a0800a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201550.739398:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681363968 00000100:00100000:3.0:1788201550.739404:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681363968 00000100:00100000:3.0:1788201550.739464:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201550.739473:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22782:x1875064681363968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201550.739620:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22782:x1875064681363968:12345-0@lo:501:mount.lustre.0 Request processed in 148us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201550.739627:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201550.739977:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681363968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201550.740025:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201550.740139:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.740172:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a0800a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201550.740247:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364096 00000100:00100000:1.0:1788201550.740251:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364096 00000100:00100000:1.0:1788201550.740286:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201550.740294:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22782:x1875064681364096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201550.740379:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22782:x1875064681364096:12345-0@lo:503:mount.lustre.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.740386:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201550.740997:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201550.744364:0:22831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22831:1875064681364224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201550.745730:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.745801:0:22831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a0800300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201550.746049:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364224 00000100:00100000:1.0:1788201550.746058:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364224 00000100:00100000:1.0:1788201550.746116:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201550.746126:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22831:x1875064681364224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201550.747041:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22831:x1875064681364224:12345-0@lo:502:llog_process_th.0 Request processed in 906us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.747049:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201550.747297:0:22831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22831:1875064681364224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201550.747333:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201550.747345:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.747348:0:22831:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201550.747356:0:22831:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0b62a4800 00000020:00000080:2.0:1788201550.747359:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201550.747366:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.747368:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.747370:0:22831:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201550.747372:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201550.747374:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.747375:0:22831:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201550.747378:0:22831:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0b62a4800 00000020:00000080:2.0:1788201550.747380:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201550.747441:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.747444:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.747451:0:22831:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788201550.747454:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201550.747617:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.747619:0:22831:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201550.747626:0:22831:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0b62a4800 00000020:00000080:2.0:1788201550.747628:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201550.747649:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.747651:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.747652:0:22831:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788201550.747655:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201550.747657:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.747658:0:22831:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788201550.747661:0:22831:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0b62a4800 00000020:00000080:2.0:1788201550.747663:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201550.747710:0:22831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22831:1875064681364352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201550.747905:0:22831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.747942:0:22831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a0800300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201550.748913:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364352 00000100:00100000:3.0:1788201550.748921:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364352 00000100:00100000:3.0:1788201550.748970:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201550.748980:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22831:x1875064681364352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201550.749423:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22831:x1875064681364352:12345-0@lo:502:llog_process_th.0 Request processed in 444us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201550.749431:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201550.750141:0:22831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22831:1875064681364352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201550.750174:0:22831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201550.750181:0:22831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201550.750183:0:22831:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788201550.750188:0:22831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788201550.750350:0:22782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788201550.750368:0:22782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201550.750389:0:22782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.750400:0:22782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201550.750863:0:22782:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201550.750867:0:22782:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0b62a4800 10000000:01000000:3.0:1788201550.750869:0:22782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0b62a4800 10000000:01000000:3.0:1788201550.750873:0:22782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201550.750878:0:22782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0b62a4800 from 1 10000000:01000000:3.0:1788201550.750881:0:22782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201550.750911:0:22782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44721cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.750924:0:22782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44721cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.750934:0:22782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44721cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201550.750951:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201550.750990:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201550.751058:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.766586:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364480 00000100:00100000:0.0:1788201550.766601:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364480 00000100:00100000:0.0:1788201550.766661:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201550.766672:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22782:x1875064681364480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201550.766691:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201550.766710:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83297a00/0xf9b71aee44721cbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721cb6 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201550.766767:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83297a00/0xf9b71aee44721cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721cb6 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201550.766793:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83297a00/0xf9b71aee44721cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721cb6 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201550.766803:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83297a00, rc 0) 00000100:00100000:0.0:1788201550.766879:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22782:x1875064681364480:12345-0@lo:101:mount.lustre.0 Request processed in 209us (15887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.766886:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201550.767686:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201550.767708:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44721cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721cbd expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.767720:0:22782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44721cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721cbd expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201550.767833:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201550.767876:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201550.767915:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.770620:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364608 00000100:00100000:0.0:1788201550.770635:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364608 00000100:00100000:0.0:1788201550.770689:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201550.770700:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22782:x1875064681364608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201550.770892:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22782:x1875064681364608:12345-0@lo:501:mount.lustre.0 Request processed in 193us (3014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.770900:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201550.771944:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201550.771996:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201550.772064:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201550.772094:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0835fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.773578:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364736 00000100:00100000:0.0:1788201550.773599:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364736 00000100:00100000:0.0:1788201550.773648:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201550.773658:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22782:x1875064681364736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201550.773823:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22782:x1875064681364736:12345-0@lo:503:mount.lustre.0 Request processed in 165us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.773830:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201550.775090:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681364736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201550.777293:0:22835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22835:1875064681364864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.777373:0:22835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201550.777544:0:22835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201550.777598:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364864 00000100:00100000:1.0:1788201550.777611:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364864 00000100:00100000:1.0:1788201550.777656:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201550.777665:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22835:x1875064681364864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201550.777930:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22835:x1875064681364864:12345-0@lo:502:llog_process_th.0 Request processed in 265us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.777937:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201550.778168:0:22835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22835:1875064681364864:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788201550.778248:0:22835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788201550.778263:0:22835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cdf831e8000) 00000020:00000080:0.0:1788201550.778282:0:22835:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788201550.783273:0:22835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0b62a4800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201550.783284:0:22835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0b62a4800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201550.783287:0:22835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0b62a4800 4 00010000:00080000:0.0:1788201550.783322:0:22835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0b9491000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1788201550.784778:0:22835:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788201550.784873:0:22835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788201550.784913:0:22835:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201550.784924:0:22835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf9b71aee44721ccb 00000100:00080000:0.0:1788201550.784934:0:22835:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201550.784939:0:22835:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ce0b9491000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201550.784971:0:22835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf696d80 x1875064681364992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201550.785008:0:22835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201550.787879:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681364992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201550.787957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201550.788037:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201550.788043:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201550.789873:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681364992 00000100:00100000:3.0:1788201550.789889:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681364992 00000100:00100000:3.0:1788201550.789932:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201550.789940:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681364992:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201550.790025:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681364992:12345-0@lo:38:llog_process_th.0 Request processed in 84us (2067us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201550.790043:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201550.790898:0:22835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22835:1875064681365120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.790961:0:22835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201550.790997:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681365120 00000100:00100000:0.0:1788201550.791002:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681365120 00000100:00100000:0.0:1788201550.791048:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201550.791055:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22835:x1875064681365120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.791162:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22835:x1875064681365120:12345-0@lo:502:llog_process_th.0 Request processed in 106us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.791169:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201550.791219:0:22835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201550.791340:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201550.791349:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9491000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201550.791354:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201550.791358:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681364992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201550.795085:0:22835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22835:1875064681365120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.795170:0:22835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22835:1875064681365248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.795258:0:22835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201550.795311:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681365248 00000100:00100000:0.0:1788201550.795318:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681365248 00000100:00100000:0.0:1788201550.795365:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201550.795377:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22835:x1875064681365248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201550.795508:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22835:x1875064681365248:12345-0@lo:502:llog_process_th.0 Request processed in 134us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.795516:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201550.795557:0:22835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.795573:0:22835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22835:1875064681365248:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201550.795967:0:22835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788201550.796550:0:22782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788201550.796581:0:22782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201550.796597:0:22782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44721cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721cbd expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201550.796608:0:22782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75600/0xf9b71aee44721cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721cbd expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201550.796658:0:22782:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201550.796661:0:22782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201550.796662:0:22782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201550.796663:0:22782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201550.796664:0:22782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201550.796666:0:22782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201550.796667:0:22782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201550.796668:0:22782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201550.796670:0:22782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201550.796671:0:22782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201550.796675:0:22782:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788201550.796677:0:22782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201550.796679:0:22782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201550.796680:0:22782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201550.796681:0:22782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201550.796682:0:22782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201550.796683:0:22782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201550.796684:0:22782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201550.796685:0:22782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201550.796686:0:22782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201550.796692:0:22782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201550.796709:0:22782:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201550.796722:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681365376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201550.796802:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201550.796829:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08507f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201550.801376:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681365376 00000100:00100000:0.0:1788201550.801390:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681365376 00000100:00100000:0.0:1788201550.801453:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201550.801464:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22782:x1875064681365376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201550.801496:0:22798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201550.801510:0:22798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201550.806139:0:22798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201550.806156:0:22798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788201550.806268:0:22819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201550.806273:0:22819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201550.806298:0:22819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.806318:0:22819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.806326:0:22819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.806364:0:22819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.806377:0:22819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 12 pid: 22798 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201550.806391:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681365504:0@lo:104: 00000100:00100000:3.0:1788201550.806511:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201550.806549:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201550.806871:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22782:x1875064681365376:12345-0@lo:253:mount.lustre.0 Request processed in 5408us (10067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201550.806881:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201550.807009:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681365504 00000100:00100000:0.0:1788201550.807016:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681365504 00000100:00100000:0.0:1788201550.807059:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201550.807067:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681365504:12345-0@lo:104: 00010000:00010000:0.0:1788201550.807079:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201550.807127:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201550.807140:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681365504:12345-0@lo:104: Request processed in 74us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201550.807146:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201550.807201:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681365504:0@lo:104: 00010000:00010000:3.0:1788201550.807218:0:22819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807328:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201550.807337:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807344:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254e00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201550.807347:0:22792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807364:0:22792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201550.807370:0:22792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201550.807375:0:22792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201550.807477:0:22792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807484:0:22792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201550.807509:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807517:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254e00/0xf9b71aee44721c9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ca1 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807533:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201550.807535:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201550.807536:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201550.807626:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681365632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201550.807655:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201550.807872:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681365632 00000100:00100000:2.0:1788201550.807878:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681365632 00010000:00010000:2.0:1788201550.807897:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 12 pid: 22798 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201550.807917:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201550.807923:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:3644:x1875064681365632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201550.807933:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201550.807938:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 12 pid: 22798 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807955:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 12 pid: 22798 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807968:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721ca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721c9a expref: 12 pid: 22798 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807984:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.807991:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201550.808002:0:22788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001730493s 00010000:00010000:2.0:1788201550.808006:0:22788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.808012:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.808018:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.808023:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.810304:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201550.810314:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.810328:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201550.810663:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22782:1875064681365376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201550.810681:0:22782:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788201550.810684:0:22782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201550.810686:0:22782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201550.810687:0:22782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201550.810688:0:22782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201550.810689:0:22782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201550.810690:0:22782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201550.810691:0:22782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201550.810693:0:22782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201550.810694:0:22782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201550.810695:0:22782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201550.810710:0:22782:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788201550.829641:0:22819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201550.829658:0:22819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.831884:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.831900:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75c00/0xf9b71aee44721cd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201550.831918:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201550.832053:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:3644:x1875064681365632:12345-0@lo:103:ldlm_bl.0 Request processed in 24126us (24393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201550.832062:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201550.832102:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681365632:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788201550.843118:0:22782:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788201550.844656:0:22782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788201550.844762:0:22842:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1788201550.844767:0:22842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1788201550.845430:0:22843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788201550.845853:0:22843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788201550.847181:0:22782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788201550.849111:0:22844:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ce0b6c8a300 x1875064681365760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201550.849124:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00000040:01000000:2.0:1788201550.849822:0:22782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788201550.849862:0:22782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788201550.850308:0:22782:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788201550.850316:0:22782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788201550.850352:0:22782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201550.854202:0:22843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201550.854299:0:22843:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788201550.857253:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788201550.860255:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201550.860333:0:22782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788201550.865300:0:22782:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788201550.866117:0:22782:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788201550.869268:0:22782:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788201550.877887:0:22782:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788201550.877925:0:22782:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc15181963988 00100000:10000000:2.0:1788201550.877934:0:22782:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788201550.879340:0:22782:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201550.879357:0:22782:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201550.879374:0:22782:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788201550.879389:0:22782:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788201550.880409:0:22782:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201550.880614:0:22782:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201551.099282:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201551.237906:0:22800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201551.237913:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b62a4800 from 11 10000000:01000000:0.0:1788201551.237916:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201551.237977:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201551.237989:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201551.237998:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201551.238024:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681365888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201551.238096:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201551.238292:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681365888 00000100:00100000:2.0:1788201551.238300:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681365888 00000100:00100000:2.0:1788201551.238359:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201551.238368:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+11:22800:x1875064681365888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201551.238381:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201551.238395:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721cd9 expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201551.238425:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 12 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201551.238435:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 12 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201551.238444:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03af800, rc 0) 00000100:00100000:2.0:1788201551.238480:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22800:x1875064681365888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201551.238486:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201551.238862:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201551.238885:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681365888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201551.238900:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201551.238908:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201551.238977:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681366016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201551.239009:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201551.239102:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681366016 00000100:00100000:2.0:1788201551.239107:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681366016 00000100:00100000:2.0:1788201551.239133:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201551.239149:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22800:x1875064681366016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201551.239163:0:22798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201551.239178:0:22798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201551.239181:0:22798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788201551.239261:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:22800:x1875064681366016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201551.239267:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201551.239377:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201551.239389:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681366016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788201551.239427:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201551.239434:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201551.239442:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201551.864701:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00000040:00080000:0.0:1788201551.867322:0:22839:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788201551.867332:0:22839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201551.870868:0:22839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788201551.870880:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788201552.123888:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201552.886373:0:22839:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788201552.886382:0:22839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201552.886506:0:22839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788201552.886550:0:22839:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201552.886691:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788201552.886968:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788201553.143163:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201553.912824:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788201554.174680:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201554.942450:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788201555.190495:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201555.602855:0:23088:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788201555.957924:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00000100:00080000:0.0:1788201556.089399:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201556.089407:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201556.089411:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201556.089419:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:0.0:1788201556.089426:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201556.089455:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b9734000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201556.089479:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf697100 x1875064681366272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201556.089496:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201556.089499:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201556.089502:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201556.089505:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201556.089507:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201556.089511:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201556.089512:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9491000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201556.089516:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ce0b9491000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201556.089529:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf694e00 x1875064681366400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201556.089560:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681366144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201556.089632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201556.089696:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681366144 00000100:00100000:0.0:1788201556.089704:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681366144 00000100:00100000:0.0:1788201556.089764:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201556.089773:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:3645:x1875064681366144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201556.089820:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:3645:x1875064681366144:12345-0@lo:400:kworker.0 Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201556.089826:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201556.089872:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681366144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201556.090043:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366272:0@lo:38:kworker.0 00000100:00100000:3.0:1788201556.090079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201556.090113:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681366400:0@lo:38:kworker.0 00000100:00100000:3.0:1788201556.090139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201556.090224:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681366272 00000100:00100000:0.0:1788201556.090228:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681366272 00000100:00100000:0.0:1788201556.090264:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201556.090270:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681366272:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201556.090287:0:22809:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201556.090320:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681366272:12345-0@lo:38:kworker.0 Request processed in 49us (240us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201556.090326:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788201556.090451:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201556.090456:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201556.090460:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366272:0@lo:38:kworker.0 00000100:00100000:2.0:1788201556.090770:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681366400 00000100:00100000:2.0:1788201556.090775:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681366400 00000100:00100000:2.0:1788201556.090802:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201556.090808:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681366400:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201556.090828:0:22805:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:2.0:1788201556.090873:0:22805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf9b71aee44721ce7 00000004:00100000:2.0:1788201556.090887:0:22805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201556.091002:0:22805:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201556.091047:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875064681366400:12345-0@lo:38:kworker.0 Request processed in 238us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201556.091054:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788201556.092504:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce0bf694e00 x1875064681366400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201556.092521:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788201556.092529:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788201556.092534:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201556.092537:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9491000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201556.092542:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875064681366400:0@lo:38:kworker.0 00010000:00010000:3.0:1788201556.223591:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788201556.928168:0:23140:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201556.928470:0:23140:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788201556.983248:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788201557.246164:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.005822:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788201558.261935:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201558.295179:0:23190:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201558.295558:0:23190:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788201559.031515:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788201559.288767:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201560.054119:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00000100:00100000:0.0:1788201560.181868:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201550/real 1788201550] req@ffff9ce0bf696300 x1875064681363072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201560 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201560.181912:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf696300 x1875064681363072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201560 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201560.181926:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201550/real 1788201550] req@ffff9cdf836c8380 x1875064681362944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201560 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201560.181939:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cdf836c8380 x1875064681362944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201560 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201560.182195:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201560.182228:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201560.182233:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681363072:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788201560.182240:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5be9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201560.182245:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201560.182248:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681362944:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788201560.182657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201560.182663:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201560.182667:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201560.182673:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1788201560.182689:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201560.182696:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b9734000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201560.182724:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba22bb80 x1875064681366656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201560.182757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201560.182760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201560.182762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5be9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201560.182766:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 630 00000100:00080000:1.0:1788201560.182768:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201560.182772:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce0a5be9000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201560.182794:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba229180 x1875064681366784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201560.183030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201560.183035:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788201560.183037:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201560.183041:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:1.0:1788201560.183044:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201560.183048:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce0a1aa3800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201560.183062:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba229880 x1875064681366912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201560.183102:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681367040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201560.183202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201560.183274:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201560.183281:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681366528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201560.183325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201560.183448:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681366528 00000100:00100000:0.0:1788201560.183460:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681366528 00000100:00100000:0.0:1788201560.183522:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201560.183532:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:3647:x1875064681366528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201560.183665:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:3647:x1875064681366528:12345-0@lo:400:kworker.0 Request processed in 133us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201560.183673:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201560.183726:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681366528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201560.183777:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366656:0@lo:38:kworker.0 00000100:00100000:0.0:1788201560.185147:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201560.185215:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366784:0@lo:8:kworker.0 00000100:00100000:1.0:1788201560.185474:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681366656 00000100:00100000:1.0:1788201560.185483:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681366656 00000100:00100000:1.0:1788201560.185524:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201560.185545:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681366656:12345-0@lo:38:kworker.0 00000400:00000100:0.0:1788201560.185670:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681366784 offset 0 length 520: 4 00000100:00100000:0.0:1788201560.185698:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366912:0@lo:8:kworker.0 00000400:00000100:0.0:1788201560.185720:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681366912 offset 0 length 520: 4 00010000:00020000:1.0:1788201560.185915:0:22809:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201560.185983:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681366656:12345-0@lo:38:kworker.0 Request processed in 437us (840us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201560.185991:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788201560.186160:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201560.186176:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201560.186197:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366656:0@lo:38:kworker.0 00000100:00100000:2.0:1788201560.186507:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367040 00000100:00100000:2.0:1788201560.186514:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367040 00000100:00100000:2.0:1788201560.188985:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201560.189009:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681367040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201560.189140:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681367040:12345-0@lo:400:kworker.0 Request processed in 142us (5937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201560.189148:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201560.189237:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce0ba22aa00 x1875064681367040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201560.189255:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681367040:0@lo:400:kworker.0 00010000:00010000:1.0:1788201560.314083:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.078649:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788201561.348470:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201562.102888:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201562.106577:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788201562.362035:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201563.125939:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788201563.382932:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201564.154013:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788201564.410565:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201565.184501:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00000100:00080000:2.0:1788201565.302795:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201565.302803:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201565.302815:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201565.302824:0:493:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:2.0:1788201565.302829:0:493:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201565.302837:0:493:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b9734000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201565.302863:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836c8700 x1875064681367296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201565.302888:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201565.302892:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201565.302894:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201565.302911:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201565.305915:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681367424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201565.306000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201565.306086:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201565.306094:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681367168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201565.306143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201565.306445:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367168 00000100:00100000:0.0:1788201565.306453:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367168 00000100:00100000:0.0:1788201565.306508:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201565.306518:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:3645:x1875064681367168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.306577:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:3645:x1875064681367168:12345-0@lo:400:kworker.0 Request processed in 61us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201565.306585:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201565.306645:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681367168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.308302:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367424 00000100:00100000:2.0:1788201565.308317:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367424 00000100:00100000:2.0:1788201565.308384:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201565.308395:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681367424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.308483:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681367424:12345-0@lo:400:kworker.0 Request processed in 90us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201565.308490:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788201565.308641:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cdf836ca300 x1875064681367424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201565.308655:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681367424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201565.309462:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681367296:0@lo:38:kworker.0 00000100:00100000:3.0:1788201565.309511:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201565.313079:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367296 00000100:00100000:1.0:1788201565.313092:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367296 00000100:00100000:1.0:1788201565.313156:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201565.313165:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681367296:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201565.313186:0:22809:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201565.313281:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681367296:12345-0@lo:38:kworker.0 Request processed in 107us (3760us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201565.313289:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788201565.313492:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201565.313498:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201565.313503:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681367296:0@lo:38:kworker.0 00010000:00010000:3.0:1788201565.435518:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201566.197807:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788201566.458669:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201566.746812:0:23535:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201566.746816:0:23535:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788201566.746817:0:23535:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788201566.749452:0:23535:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0aafde000 00000020:01000004:0.0:1788201566.749474:0:23535:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788201566.749488:0:23535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788201566.749502:0:23535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9cdf831e99c0) 00000020:00000080:0.0:1788201566.749519:0:23535:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201566.840254:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788201566.842024:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788201566.849536:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.853496:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.854240:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.856104:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.864346:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.865399:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.865952:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.866359:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.866786:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.867459:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.869060:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.872342:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.873274:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.873582:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.873956:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.876969:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.877810:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.878600:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.878946:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.879247:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.879435:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.879615:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.879894:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.880404:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.881809:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.882334:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.882639:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.882959:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.883382:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.884150:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788201566.884409:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.884861:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788201566.887869:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788201566.888435:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788201566.888671:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788201566.889005:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788201566.889247:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788201566.889451:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788201566.889711:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788201566.892190:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788201566.892633:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788201566.893043:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788201566.893377:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788201566.893564:0:23535:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788201566.894582:0:23535:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788201566.895017:0:23535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788201566.895028:0:23535:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201566.895041:0:23535:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721cf5 00000020:01000004:2.0:1788201566.895048:0:23535:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788201566.895078:0:23535:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788201566.895081:0:23535:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788201566.895087:0:23535:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788201566.895114:0:23535:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788201566.895118:0:23535:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788201566.904538:0:23535:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201566.904587:0:23535:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788201566.904592:0:23535:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201566.904594:0:23535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201566.904595:0:23535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201566.904596:0:23535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201566.904597:0:23535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201566.904599:0:23535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201566.904600:0:23535:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201566.904602:0:23535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201566.904603:0:23535:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201566.904606:0:23535:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788201566.904609:0:23535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201566.904610:0:23535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201566.904617:0:23535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201566.904618:0:23535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201566.904618:0:23535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201566.904620:0:23535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201566.904621:0:23535:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201566.904622:0:23535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201566.904623:0:23535:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201566.904651:0:23535:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788201566.904673:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367552:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201566.904764:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201566.904802:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2efd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201566.908321:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367552 00000100:00100000:1.0:1788201566.908334:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367552 00000100:00100000:1.0:1788201566.908403:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201566.908412:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:23535:x1875064681367552:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201566.908450:0:22798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788201566.908453:0:22798:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788201566.908461:0:22798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788201566.908957:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:23535:x1875064681367552:12345-0@lo:253:mount.lustre.0 Request processed in 545us (4218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201566.908966:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201566.909492:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367552:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201566.909506:0:23535:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788201566.909509:0:23535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201566.909512:0:23535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201566.909513:0:23535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201566.909514:0:23535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201566.909515:0:23535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201566.909516:0:23535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201566.909518:0:23535:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201566.909519:0:23535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201566.909521:0:23535:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201566.909539:0:23535:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0aafde000 from lustre-MDT0001 10000000:01000000:0.0:1788201566.909568:0:23535:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788201566.909571:0:23535:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788201566.909577:0:23535:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0a6580000 local copy 00010000:00010000:0.0:1788201566.909587:0:23535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201566.909683:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201566.909723:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201566.909802:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201566.909879:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367680 00000100:00100000:1.0:1788201566.909884:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367680 00000100:00100000:1.0:1788201566.909921:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201566.909929:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:23535:x1875064681367680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201566.910006:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:23535:x1875064681367680:12345-0@lo:501:mount.lustre.0 Request processed in 78us (283us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201566.910013:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201566.913653:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367680:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201566.913681:0:23535:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201566.913730:0:23535:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201566.913777:0:23535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.913789:0:23535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201566.913819:0:23535:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0aafde000 10000000:01000000:3.0:1788201566.913824:0:23535:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201566.913829:0:23535:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ce0a6580000 10000000:01000000:3.0:1788201566.913832:0:23535:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788201566.913835:0:23535:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9ce0a6580000 from 1 10000000:01000000:3.0:1788201566.913838:0:23535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788201566.913872:0:23535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44721cfc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.913881:0:23535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44721cfc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.913891:0:23535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44721cfc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201566.913912:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201566.913965:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201566.914010:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201566.914024:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367808 00000100:00100000:1.0:1788201566.914035:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367808 00000100:00100000:1.0:1788201566.914077:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201566.914086:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+12:23535:x1875064681367808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201566.914098:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201566.914110:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255e00/0xf9b71aee44721d03 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721cfc expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201566.914145:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255e00/0xf9b71aee44721d03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721cfc expref: 13 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201566.914167:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255e00/0xf9b71aee44721d03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721cfc expref: 13 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201566.914175:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255e00, rc 0) 00000100:00100000:1.0:1788201566.914224:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+13:23535:x1875064681367808:12345-0@lo:101:mount.lustre.0 Request processed in 139us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201566.914231:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201566.915044:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201566.915058:0:23535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44721cfc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d03 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915067:0:23535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44721cfc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721d03 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201566.915083:0:23535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788201566.915099:0:23535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44721cfc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d03 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915106:0:23535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a74a00/0xf9b71aee44721cfc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d03 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201566.915115:0:23535:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce0aafde000 10000000:01000000:3.0:1788201566.915136:0:23535:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788201566.915140:0:23535:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ce0aafde000 from 1 10000000:01000000:3.0:1788201566.915142:0:23535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201566.915160:0:23535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75200/0xf9b71aee44721d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915168:0:23535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75200/0xf9b71aee44721d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915176:0:23535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75200/0xf9b71aee44721d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201566.915187:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201566.915214:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201566.915258:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201566.915406:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681367936 00000100:00100000:1.0:1788201566.915411:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681367936 00000100:00100000:1.0:1788201566.915452:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201566.915460:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+13:23535:x1875064681367936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201566.915468:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201566.915478:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721d0a expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201566.915492:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721d0a expref: 14 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201566.915501:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254200/0xf9b71aee44721d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721d0a expref: 14 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201566.915513:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254200, rc 0) 00000100:00100000:1.0:1788201566.915546:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+14:23535:x1875064681367936:12345-0@lo:101:mount.lustre.0 Request processed in 87us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201566.915551:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201566.915616:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681367936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201566.915626:0:23535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75200/0xf9b71aee44721d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d11 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915633:0:23535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75200/0xf9b71aee44721d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721d11 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201566.915642:0:23535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201566.915657:0:23535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75200/0xf9b71aee44721d0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d11 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915665:0:23535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75200/0xf9b71aee44721d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d11 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201566.915670:0:23535:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788201566.915674:0:23535:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201566.915678:0:23535:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce0aafde000 10000000:01000000:3.0:1788201566.915680:0:23535:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788201566.915683:0:23535:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788201566.915685:0:23535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201566.915696:0:23535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44721d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915703:0:23535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44721d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.915709:0:23535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44721d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201566.915728:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201566.915782:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201566.915797:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201566.915845:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368064 00000100:00100000:0.0:1788201566.915849:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368064 00000100:00100000:0.0:1788201566.915884:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201566.915890:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+14:23535:x1875064681368064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201566.915896:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201566.915904:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83296000/0xf9b71aee44721d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721d18 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201566.915916:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83296000/0xf9b71aee44721d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721d18 expref: 15 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201566.915924:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83296000/0xf9b71aee44721d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721d18 expref: 15 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201566.915930:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83296000, rc 0) 00000100:00100000:0.0:1788201566.915954:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368064:12345-0@lo:101:mount.lustre.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201566.915959:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201566.916024:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201566.916033:0:23535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44721d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d1f expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201566.916040:0:23535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44721d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721d1f expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201566.919470:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788201566.920224:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201566.933386:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788201566.933441:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788201566.933457:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788201566.933469:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788201566.933481:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788201566.933494:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788201566.933505:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788201566.933518:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788201566.933545:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788201566.933561:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788201566.933573:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788201566.933584:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788201566.933596:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788201566.933609:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788201566.933623:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788201566.933636:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788201566.933648:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788201566.933669:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788201566.933680:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788201566.933691:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788201566.933703:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788201566.933715:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788201566.933727:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788201566.933786:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788201566.933819:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788201566.933842:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788201566.933857:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788201566.933872:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788201566.933885:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788201566.933899:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788201566.933914:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788201566.933928:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788201566.933943:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788201566.933956:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788201566.933970:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788201566.933983:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788201566.933997:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788201566.934012:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788201566.934026:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788201566.934040:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788201566.934070:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788201566.934086:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788201566.934100:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788201566.934114:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788201566.934165:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788201566.934172:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788201566.934274:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201566.934334:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201566.934368:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b32fc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201566.934576:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368192 00000100:00100000:0.0:1788201566.934583:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368192 00000100:00100000:0.0:1788201566.934629:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201566.934638:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201566.934819:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368192:12345-0@lo:501:mount.lustre.0 Request processed in 181us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201566.934826:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201566.934920:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201566.934956:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201566.934995:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201566.935017:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201566.936132:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368320 00000100:00100000:2.0:1788201566.936142:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368320 00000100:00100000:2.0:1788201566.936182:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201566.936190:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201566.937237:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368320:12345-0@lo:503:mount.lustre.0 Request processed in 1044us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201566.937246:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201566.937348:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201566.937817:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201566.937900:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201566.937962:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201566.938049:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201566.938132:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368448 00000100:00100000:0.0:1788201566.938139:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368448 00000100:00100000:0.0:1788201566.938179:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201566.938189:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201566.939137:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368448:12345-0@lo:502:mount.lustre.0 Request processed in 945us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201566.939146:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201566.939273:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201566.939512:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788201566.939539:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788201566.939551:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788201566.939562:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788201566.939573:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788201566.939584:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788201566.939595:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788201566.939606:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788201566.939618:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788201566.939629:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788201566.939640:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788201566.939651:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788201566.939662:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788201566.939684:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788201566.939697:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788201566.939711:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788201566.939724:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788201566.939735:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788201566.941278:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788201566.941295:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788201566.941307:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788201566.941319:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788201566.941331:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788201566.941343:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788201566.941355:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788201566.941367:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788201566.941378:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788201566.941389:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788201566.941400:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788201566.941432:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788201566.941448:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788201566.941460:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788201566.941484:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788201566.941498:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788201566.941510:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788201566.941522:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788201566.941535:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788201566.941547:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788201566.941558:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788201566.941569:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788201566.941580:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788201566.941591:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788201566.941603:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788201566.941614:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788201566.941655:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201566.941727:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201566.942713:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201566.946247:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368576 00000100:00100000:3.0:1788201566.946260:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368576 00000100:00100000:3.0:1788201566.946327:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201566.946338:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201566.946511:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681368576:12345-0@lo:502:mount.lustre.0 Request processed in 174us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201566.946519:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201566.948869:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681368576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201566.948984:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788201566.948999:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788201566.949946:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201566.949958:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201566.949960:0:23539:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788201566.949967:0:23539:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788201566.949970:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201566.949984:0:23539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9cdf831ecd40) 00000020:00000080:0.0:1788201566.950005:0:23539:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788201566.950010:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201566.950095:0:23539:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788201566.950102:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721d2d 00000020:00000080:0.0:1788201566.950310:0:23539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788201566.950315:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201566.950319:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201566.950325:0:23539:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788201566.950329:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201566.950333:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201566.950334:0:23539:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788201566.950337:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201566.950345:0:23539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ce0c15019c0) 00000020:00000080:0.0:1788201566.950356:0:23539:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788201566.950360:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201566.950362:0:23539:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788201566.950365:0:23539:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788201566.950371:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201566.950414:0:23539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0aafde000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788201566.950426:0:23539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ce0c1503380) 00000020:00000080:0.0:1788201566.950435:0:23539:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788201566.950512:0:23539:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201566.950520:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721d42 00000020:00000080:0.0:1788201566.950609:0:23539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788201566.950617:0:23539:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201566.950621:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf9b71aee44721d49 00080000:01000000:0.0:1788201566.950627:0:23539:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201566.950632:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721d50 00010000:00010000:2.0:1788201567.037323:0:23539:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788201567.048733:0:23539:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788201567.051083:0:23539:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788201567.058942:0:23539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788201567.058957:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201567.058978:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.058981:0:23539:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788201567.058985:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201567.058992:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.058993:0:23539:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788201567.058997:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201567.059003:0:23539:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:1.0:1788201567.059034:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201567.059051:0:23539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ce0a643cd40) 00000020:00000080:1.0:1788201567.059074:0:23539:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788201567.059081:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201567.059197:0:23539:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788201567.059204:0:23539:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788201567.059212:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721d5e 00010000:00080000:1.0:1788201567.059249:0:23539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0a03a5800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201567.062645:0:23539:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788201567.064856:0:23539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788201567.064870:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201567.064909:0:23539:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201567.064943:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721d65 00000100:00080000:2.0:1788201567.064954:0:23539:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201567.064960:0:23539:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce0a03a5800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201567.065007:0:23539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836c8700 x1875064681368704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201567.065037:0:23539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788201567.065087:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201567.065099:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201567.065101:0:23539:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788201567.065105:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201567.065108:0:23539:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788201567.065109:0:23539:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201567.065111:0:23539:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201567.065112:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201567.065114:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201567.065116:0:23539:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201567.065118:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201567.065149:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201567.065151:0:23539:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788201567.065155:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201567.065186:0:23539:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201567.065201:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201567.065205:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201567.065207:0:23539:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788201567.065210:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201567.065211:0:23539:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788201567.065213:0:23539:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201567.065214:0:23539:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201567.065216:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201567.065218:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201567.065220:0:23539:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201567.065222:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201567.065225:0:23539:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788201567.065229:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201567.065230:0:23539:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201567.065233:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201567.065237:0:23539:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:2.0:1788201567.065260:0:23539:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788201567.065456:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201567.065469:0:23539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ce0bf4519c0) 00000020:00000080:2.0:1788201567.065482:0:23539:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788201567.065493:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201567.065566:0:23539:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788201567.065573:0:23539:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201567.065578:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721d73 00010000:00080000:2.0:1788201567.065608:0:23539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce0b94fb800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1788201567.065841:0:23539:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788201567.066033:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681368704:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201567.066111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201567.066187:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201567.066192:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201567.066195:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201567.066200:0:493:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 645 00000100:00080000:1.0:1788201567.066203:0:493:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201567.066208:0:493:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b9734000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201567.066229:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba22b800 x1875064681368832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201567.066246:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201567.066250:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201567.066253:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201567.066256:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201567.066307:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368704 00000100:00100000:1.0:1788201567.066314:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368704 00000100:00100000:1.0:1788201567.066349:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201567.066356:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875064681368704:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201567.066378:0:22809:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:1.0:1788201567.066407:0:22809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721d7a 00000004:00100000:1.0:1788201567.066430:0:22809:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788201567.066436:0:22809:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788201567.066499:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201567.066531:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681368960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201567.066563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.066669:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368960 00000100:00100000:1.0:1788201567.066673:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368960 00000100:00100000:1.0:1788201567.066703:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201567.066710:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681368960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201567.066786:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681368960:12345-0@lo:400:kworker.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.066793:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788201567.066829:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce0ba22b100 x1875064681368960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201567.066842:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681368960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201567.066865:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681368832:0@lo:38:kworker.0 00000100:00100000:1.0:1788201567.066902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.066944:0:22808:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788201567.066952:0:22808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788201567.067082:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681368832 00000100:00100000:1.0:1788201567.067087:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681368832 00000100:00100000:1.0:1788201567.067170:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201567.067175:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875064681368832:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788201567.067228:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1875064681368832:12345-0@lo:38:kworker.0 Request processed in 51us (325us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201567.067236:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201567.067260:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201567.067274:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201567.067279:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201567.067282:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681368832:0@lo:38:kworker.0 00000040:01000000:2.0:1788201567.070403:0:23539:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201567.070727:0:23539:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788201567.072273:0:23539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201567.072533:0:23539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788201567.072676:0:23539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788201567.075073:0:23545:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788201567.075080:0:23545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1788201567.076567:0:22809:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94ff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201567.077057:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681368704:12345-0@lo:38:llog_process_th.0 Request processed in 10698us (10943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201567.077070:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:1.0:1788201567.077195:0:23539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201567.077209:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201567.077264:0:23539:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788201567.077285:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721d81 00000100:00080000:1.0:1788201567.077294:0:23539:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201567.077299:0:23539:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce0b94fb800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201567.077329:0:23539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0ba22b800 x1875064681369088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201567.077357:0:23539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788201567.077420:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201567.077425:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.077427:0:23539:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788201567.077430:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201567.077433:0:23539:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788201567.077435:0:23539:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201567.077437:0:23539:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201567.077438:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201567.077441:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.077442:0:23539:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201567.077445:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201567.077450:0:23539:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788201567.077453:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.077454:0:23539:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788201567.077457:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201567.077461:0:23539:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:1.0:1788201567.077482:0:23539:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788201567.077485:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201567.077506:0:23539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ce0a643b380) 00000020:00000080:1.0:1788201567.077518:0:23539:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788201567.077525:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201567.077587:0:23539:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788201567.077594:0:23539:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788201567.077603:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf9b71aee44721d8f 00010000:00080000:1.0:1788201567.077631:0:23539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce087eb6000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201567.077861:0:23539:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788201567.077942:0:23539:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201567.077957:0:23539:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788201567.078137:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201567.078142:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201567.078145:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201567.078148:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788201567.083327:0:23539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201567.084102:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201567.084117:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788201567.084139:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788201567.084144:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201567.084148:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a03a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201567.084168:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681368704:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201567.084202:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681369088:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788201567.084252:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681369088 offset 0 length 520: 4 00000100:00100000:0.0:1788201567.084616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681369216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201567.084657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.084757:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681369216 00000100:00100000:1.0:1788201567.084764:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681369216 00000100:00100000:1.0:1788201567.084814:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201567.084823:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875064681369216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201567.084854:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788201567.084901:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875064681369216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.084909:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201567.085095:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681369216:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788201567.085193:0:23539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788201567.085370:0:23539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1788201567.085812:0:23547:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788201567.085817:0:23547:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201567.086549:0:23539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201567.086564:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201567.086600:0:23539:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201567.086621:0:23539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721d96 00000100:00080000:3.0:1788201567.086630:0:23539:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201567.086636:0:23539:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce087eb6000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201567.086672:0:23539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c89f80 x1875064681369344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201567.086729:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681369344:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788201567.086860:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681369344 offset 0 length 520: 4 00000100:00080000:3.0:1788201567.086936:0:23539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201567.087003:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201567.087008:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201567.087010:0:23539:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201567.087014:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201567.087018:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201567.087019:0:23539:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201567.087022:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201567.087024:0:23539:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201567.087026:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201567.087029:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201567.087030:0:23539:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201567.087033:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201567.087035:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201567.087036:0:23539:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201567.087040:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201567.087064:0:23539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201567.087067:0:23539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201567.087068:0:23539:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201567.087071:0:23539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1788201567.087322:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201567.087334:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201567.087337:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201567.087340:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788201567.087368:0:23535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788201567.087397:0:23535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788201567.087461:0:23535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44721d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d1f expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.087473:0:23535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75c00/0xf9b71aee44721d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721d1f expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201567.087487:0:23535:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0aafde000 from 1 10000000:01000000:1.0:1788201567.087491:0:23535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201567.087517:0:23535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.087526:0:23535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.087537:0:23535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.087553:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201567.087592:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.087617:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201567.087666:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681369472 00000100:00100000:3.0:1788201567.087673:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681369472 00000100:00100000:3.0:1788201567.087772:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201567.087782:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+15:23535:x1875064681369472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201567.087795:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201567.087808:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721d9d expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201567.087831:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 16 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201567.087852:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 16 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201567.087861:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75a00, rc 0) 00000100:00100000:3.0:1788201567.087897:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+16:23535:x1875064681369472:12345-0@lo:101:mount.lustre.0 Request processed in 117us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.087904:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201567.088110:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201567.088134:0:23535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.088144:0:23535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.088686:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369600:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788201567.088731:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.088904:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0830cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201567.089107:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681369600 00000100:00100000:3.0:1788201567.089113:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681369600 00000100:00100000:3.0:1788201567.089169:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201567.089177:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+16:23535:x1875064681369600:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788201567.089194:0:22797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788201567.089211:0:22797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788201567.089214:0:22797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788201567.089313:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+16:23535:x1875064681369600:12345-0@lo:256:mount.lustre.0 Request processed in 136us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.089320:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201567.089432:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369600:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788201567.090246:0:23535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201567.090267:0:23535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201567.090277:0:23535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201567.090284:0:23535:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0aafde000 from 1 10000000:01000000:0.0:1788201567.090286:0:23535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201567.090311:0:23535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201567.090317:0:23535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201567.090326:0:23535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201567.090341:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201567.090375:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201567.090399:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a19d1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201567.090447:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681369728 00000100:00100000:3.0:1788201567.090452:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681369728 00000100:00100000:3.0:1788201567.090485:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201567.090493:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+16:23535:x1875064681369728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201567.090502:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201567.090513:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721dab expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201567.090533:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721dab expref: 17 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201567.090555:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721dab expref: 17 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201567.090562:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75800, rc 0) 00000100:00100000:3.0:1788201567.090593:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681369728:12345-0@lo:101:mount.lustre.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.090600:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201567.090686:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201567.090699:0:23535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201567.090712:0:23535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201567.091904:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788201567.092264:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201567.092478:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788201567.092514:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788201567.092531:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788201567.092543:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788201567.092557:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788201567.092571:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788201567.092586:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788201567.092606:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788201567.092622:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788201567.092635:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788201567.092648:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788201567.092665:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788201567.092670:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788201567.092734:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201567.092876:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201567.093050:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a19d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201567.093103:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681369856 00000100:00100000:2.0:1788201567.093110:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681369856 00000100:00100000:2.0:1788201567.093189:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201567.093197:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681369856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201567.093294:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681369856:12345-0@lo:501:mount.lustre.0 Request processed in 98us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201567.093300:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201567.093362:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201567.093388:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201567.093423:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201567.093501:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a19d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201567.093537:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681369984 00000100:00100000:3.0:1788201567.093541:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681369984 00000100:00100000:3.0:1788201567.093563:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201567.093570:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681369984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201567.093659:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681369984:12345-0@lo:503:mount.lustre.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.093666:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201567.093775:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681369984:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201567.094136:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201567.094197:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201567.094234:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201567.094265:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082be0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201567.094488:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681370112 00000100:00100000:3.0:1788201567.094493:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681370112 00000100:00100000:3.0:1788201567.094532:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201567.094540:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681370112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201567.094629:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681370112:12345-0@lo:502:mount.lustre.0 Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.094636:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201567.094712:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201567.094899:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788201567.095047:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788201567.095064:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788201567.095092:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788201567.095107:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788201567.095132:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788201567.095148:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788201567.095163:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788201567.095177:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788201567.095197:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788201567.095213:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788201567.095236:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201567.095273:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201567.095333:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082be0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201567.095495:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681370240 00000100:00100000:2.0:1788201567.095501:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681370240 00000100:00100000:3.0:1788201567.095694:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201567.095703:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681370240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201567.095895:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681370240:12345-0@lo:502:mount.lustre.0 Request processed in 192us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.095914:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201567.096097:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201567.096175:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788201567.096186:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788201567.100613:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201567.100626:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.100629:0:23549:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201567.100650:0:23549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0aafde000 00000020:00000080:1.0:1788201567.100654:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201567.100664:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201567.100667:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.100669:0:23549:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788201567.100671:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201567.100675:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.100677:0:23549:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201567.100680:0:23549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0aafde000 00000020:00000080:1.0:1788201567.100682:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201567.100913:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201567.100928:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.100930:0:23549:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788201567.100933:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201567.100935:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.100937:0:23549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788201567.100941:0:23549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0aafde000 00000020:00000080:1.0:1788201567.100943:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201567.103269:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201567.103284:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.103286:0:23549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788201567.103290:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201567.103294:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.103296:0:23549:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788201567.103301:0:23549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0aafde000 00000020:00000080:1.0:1788201567.103303:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201567.103380:0:23549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201567.103384:0:23549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201567.103386:0:23549:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788201567.103389:0:23549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788201567.103494:0:23535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788201567.103531:0:23535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201567.103555:0:23535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201567.103567:0:23535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201567.103622:0:23535:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201567.103625:0:23535:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0aafde000 10000000:01000000:0.0:1788201567.103629:0:23535:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0aafde000 10000000:01000000:0.0:1788201567.103645:0:23535:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201567.103651:0:23535:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0aafde000 from 1 10000000:01000000:0.0:1788201567.103654:0:23535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201567.103689:0:23535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297800/0xf9b71aee44721db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201567.103698:0:23535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83297800/0xf9b71aee44721db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201567.103709:0:23535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83297800/0xf9b71aee44721db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201567.103733:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201567.103845:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201567.103887:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce082be0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201567.104067:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681370368 00000100:00100000:1.0:1788201567.104075:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681370368 00000100:00100000:1.0:1788201567.104113:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201567.104139:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:23535:x1875064681370368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201567.104158:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201567.104171:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254600/0xf9b71aee44721dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721db9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.104195:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254600/0xf9b71aee44721dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721db9 expref: 18 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.104205:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254600/0xf9b71aee44721dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721db9 expref: 18 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.104215:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254600, rc 0) 00000100:00100000:1.0:1788201567.104264:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370368:12345-0@lo:101:mount.lustre.0 Request processed in 144us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.104272:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201567.105066:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201567.105087:0:23535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83297800/0xf9b71aee44721db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721dc0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201567.105115:0:23535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83297800/0xf9b71aee44721db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721dc0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201567.106856:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788201567.107161:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201567.107436:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788201567.107470:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788201567.107495:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788201567.107517:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788201567.107537:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788201567.107557:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788201567.107597:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788201567.107619:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788201567.107732:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788201567.107784:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788201567.107801:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788201567.107823:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788201567.107842:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788201567.107855:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788201567.107867:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788201567.107882:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788201567.107894:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788201567.107907:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788201567.107920:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788201567.107932:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788201567.107943:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788201567.107955:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788201567.107967:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788201567.107982:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788201567.107995:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788201567.108006:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788201567.108018:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788201567.108030:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788201567.108044:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788201567.108058:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788201567.108083:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788201567.108096:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788201567.108107:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788201567.108129:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788201567.108146:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788201567.108159:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788201567.108171:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788201567.108182:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788201567.108205:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788201567.108218:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788201567.108229:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788201567.108241:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788201567.108253:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788201567.108265:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788201567.108279:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788201567.108292:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788201567.108316:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788201567.108331:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1788201567.108456:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1788201567.108476:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1788201567.108492:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1788201567.108497:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1788201567.108604:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201567.108663:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201567.108711:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0862d9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201567.110905:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681370496 00000100:00100000:1.0:1788201567.110917:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681370496 00000100:00100000:1.0:1788201567.110967:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201567.110976:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201567.111145:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370496:12345-0@lo:501:mount.lustre.0 Request processed in 169us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.111152:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201567.111211:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201567.111256:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201567.111300:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.111332:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201567.111346:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681370624 00000100:00100000:1.0:1788201567.111350:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681370624 00000100:00100000:1.0:1788201567.111380:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201567.111386:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201567.111467:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370624:12345-0@lo:503:mount.lustre.0 Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.111474:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201567.111518:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201567.111956:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201567.112022:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201567.112059:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.112091:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201567.112107:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681370752 00000100:00100000:1.0:1788201567.112110:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681370752 00000100:00100000:1.0:1788201567.112153:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201567.112161:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201567.112263:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370752:12345-0@lo:502:mount.lustre.0 Request processed in 103us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.112270:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201567.112571:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201567.112796:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788201567.112825:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788201567.112839:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788201567.112852:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788201567.112863:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788201567.113447:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788201567.113479:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788201567.113492:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788201567.113506:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788201567.113519:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788201567.113532:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788201567.113546:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788201567.113559:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788201567.113587:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788201567.113609:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788201567.113625:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788201567.113649:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788201567.113663:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788201567.113675:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788201567.113688:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788201567.113699:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788201567.113711:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788201567.113725:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788201567.113763:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788201567.113780:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788201567.113794:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788201567.113811:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788201567.113828:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788201567.113842:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788201567.113869:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788201567.113887:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788201567.113901:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788201567.114211:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788201567.114234:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788201567.114253:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788201567.114275:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788201567.114294:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788201567.114309:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788201567.114328:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788201567.114358:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788201567.114383:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788201567.114403:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788201567.114422:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788201567.114449:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788201567.114474:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788201567.114509:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788201567.114528:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788201567.114549:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788201567.114602:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201567.114678:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201567.114722:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201567.114774:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681370880 00000100:00100000:2.0:1788201567.114781:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681370880 00000100:00100000:1.0:1788201567.116578:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201567.116595:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201567.118520:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681370880:12345-0@lo:502:mount.lustre.0 Request processed in 1925us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.118534:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201567.118622:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681370880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201567.118868:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788201567.118896:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788201567.118937:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681371008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201567.118980:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.119019:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201567.119185:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371008 00000100:00100000:2.0:1788201567.119193:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371008 00000100:00100000:2.0:1788201567.119255:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201567.119266:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681371008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201567.119381:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681371008:12345-0@lo:502:mount.lustre.0 Request processed in 116us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201567.119389:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201567.119436:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681371008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201567.119475:0:23535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788201567.119483:0:23535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788201567.120778:0:23552:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788201567.120794:0:23552:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ce0bf453380) 00000020:00000080:2.0:1788201567.120818:0:23552:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788201567.122378:0:23552:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0aafde000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788201567.122386:0:23552:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0aafde000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788201567.122390:0:23552:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0aafde000 3 00010000:00080000:2.0:1788201567.122427:0:23552:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ce09d400800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201567.131152:0:23552:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788201567.131286:0:23552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788201567.131341:0:23552:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201567.131354:0:23552:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf9b71aee44721dce 00000100:00080000:3.0:1788201567.131366:0:23552:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201567.131373:0:23552:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ce09d400800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201567.131411:0:23552:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c89500 x1875064681371136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201567.131456:0:23552:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201567.133214:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201567.133223:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201567.133226:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201567.133228:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788201567.133717:0:23552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:1.0:1788201567.133873:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681371136:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201567.133942:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788201567.134037:0:23535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788201567.134069:0:23535:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201567.134083:0:23535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297800/0xf9b71aee44721db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721dc0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.134094:0:23535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83297800/0xf9b71aee44721db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721dc0 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201567.134167:0:23535:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201567.134169:0:23535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201567.134171:0:23535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201567.134172:0:23535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201567.134173:0:23535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201567.134175:0:23535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201567.134177:0:23535:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201567.134178:0:23535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201567.134180:0:23535:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201567.134183:0:23535:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788201567.134186:0:23535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201567.134187:0:23535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201567.134188:0:23535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201567.134190:0:23535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201567.134190:0:23535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201567.134192:0:23535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201567.134197:0:23535:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201567.134198:0:23535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201567.134199:0:23535:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201567.134219:0:23535:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788201567.134233:0:23535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681371264:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201567.134265:0:23535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.134281:0:23535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201567.134308:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371264 00000100:00100000:1.0:1788201567.134314:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371264 00000100:00100000:1.0:1788201567.134366:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201567.134375:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681371264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201567.134402:0:22797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788201567.134414:0:22797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788201567.142496:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371136 00000100:00100000:0.0:1788201567.142510:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371136 00000100:00100000:0.0:1788201567.142556:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201567.142564:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681371136:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201567.142590:0:22805:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:0.0:1788201567.142641:0:22805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf9b71aee44721dd5 00000004:00100000:0.0:1788201567.142658:0:22805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201567.142690:0:22805:0:(import.c:65:import_set_state_nolock()) ffff9cdf826f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201567.142801:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875064681371136:12345-0@lo:38:llog_process_th.0 Request processed in 236us (8858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201567.142820:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788201567.145356:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce0b6c89500 x1875064681371136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201567.145371:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201567.145380:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788201567.145389:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788201567.145394:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201567.145397:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce09d400800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201567.145404:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875064681371136:0@lo:38:llog_process_th.0 00000001:00100000:1.0:1788201567.148248:0:22783:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788201567.148287:0:22797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201567.148299:0:22797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788201567.148372:0:22819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201567.148377:0:22819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201567.148399:0:22819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148430:0:22819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 18 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148438:0:22819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 18 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148446:0:22819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148482:0:22819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 18 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148498:0:22819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 18 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.148513:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681371392:0@lo:104: 00000100:00100000:1.0:1788201567.148572:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201567.148619:0:22819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 18 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148627:0:22819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 18 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.148636:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681371520:0@lo:104: 00000100:00100000:1.0:1788201567.148658:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.148674:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf8192a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201567.148712:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371392 00000100:00100000:1.0:1788201567.148719:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371392 00000100:00100000:1.0:1788201567.148781:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371520 00000100:00100000:1.0:1788201567.148790:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371520 00000100:00100000:1.0:1788201567.148809:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201567.148816:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:22819:x1875064681371392:12345-0@lo:104: 00010000:00010000:1.0:1788201567.148828:0:22787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148883:0:22787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201567.148888:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:22819:x1875064681371392:12345-0@lo:104: Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.148894:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201567.148911:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201567.148924:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681371520:12345-0@lo:104: 00010000:00010000:1.0:1788201567.148932:0:22787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.148962:0:22787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201567.148968:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681371520:12345-0@lo:104: Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.148974:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788201567.148991:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201567.148996:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149003:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201567.149008:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149016:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201567.149033:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201567.149038:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201567.149061:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149066:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201567.149084:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149092:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721d9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721da4 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149103:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201567.149106:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149111:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83296400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:1.0:1788201567.149114:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149304:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201567.149311:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201567.149316:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201567.149338:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149344:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201567.149350:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149356:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44721cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ce0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149369:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201567.149370:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201567.149372:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201567.149379:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201567.149396:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681371776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201567.149422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.149447:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201567.149452:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681371648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201567.149469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.149496:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371776 00000100:00100000:1.0:1788201567.149500:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371776 00010000:00010000:1.0:1788201567.149516:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 19 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.149533:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371648 00000100:00100000:1.0:1788201567.149535:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371648 00010000:00010000:1.0:1788201567.149543:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 20 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.149553:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201567.149558:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:3645:x1875064681371776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201567.149573:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201567.149579:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 20 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149588:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 20 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149602:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201567.149630:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:3645:x1875064681371776:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.149636:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201567.149649:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201567.149656:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:3645:x1875064681371648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201567.149663:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201567.149667:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 19 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149675:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 19 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149686:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149694:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201567.149708:0:22788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001730493s 00010000:00010000:1.0:1788201567.149712:0:22788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149729:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149758:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149766:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149772:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201567.149776:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149783:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149792:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.149801:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201567.149826:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:3645:x1875064681371648:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.149833:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201567.149890:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:23535:x1875064681371264:12345-0@lo:253:mount.lustre.0 Request processed in 15517us (15624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201567.149898:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201567.150004:0:23535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:23535:1875064681371264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201567.150013:0:23535:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788201567.150021:0:23535:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201567.150023:0:23535:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201567.150024:0:23535:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201567.150025:0:23535:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201567.150026:0:23535:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201567.150028:0:23535:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201567.150029:0:23535:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201567.150031:0:23535:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201567.150032:0:23535:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201567.150044:0:23535:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788201567.151263:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681371648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201567.151274:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681371776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201567.151301:0:22819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75a00/0xf9b71aee44721da4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721d9d expref: 17 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.151313:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba228700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681371392:0@lo:104: 00010000:00010000:1.0:1788201567.151321:0:22819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03af800/0xf9b71aee44721ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721cd9 expref: 16 pid: 22797 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201567.151328:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681371520:0@lo:104: 00010000:00010000:1.0:1788201567.151340:0:22819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.151349:0:22819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.151356:0:22819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201567.151362:0:22819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254a00/0xf9b71aee44721ddc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1788201567.159048:0:23535:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788201567.159323:0:23561:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201567.159565:0:23535:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788201567.161274:0:23561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788201567.162954:0:23535:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788201567.163039:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788201567.163521:0:23535:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788201567.163529:0:23535:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788201567.163571:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201567.164651:0:23535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788201567.165230:0:23535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788201567.165263:0:23535:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788201567.165357:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788201567.165863:0:23535:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:0.0:1788201567.167629:0:23561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201567.167698:0:23561:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:2.0:1788201567.168283:0:23560:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788201567.168288:0:23560:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788201567.169203:0:23562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875064681371904:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201567.169272:0:23562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.169301:0:23562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09426e480 going to sleep for 11 seconds 00000001:00000004:1.0:1788201567.170024:0:23535:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788201567.170189:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681371904 00000100:00100000:2.0:1788201567.170196:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681371904 00000100:00100000:2.0:1788201567.170242:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201567.170251:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23562:x1875064681371904:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201567.170337:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23562:x1875064681371904:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 87us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201567.170344:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201567.170525:0:23562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875064681371904:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788201567.170558:0:23562:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788201567.170605:0:23562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875064681372032:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201567.170643:0:23562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.170668:0:23562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085ea3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201567.170711:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372032 00000100:00100000:0.0:1788201567.170715:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372032 00000100:00100000:0.0:1788201567.170767:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201567.170775:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23562:x1875064681372032:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201567.170871:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23562:x1875064681372032:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201567.170878:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201567.171065:0:23562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875064681372032:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201567.171135:0:23562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23562:1875064681372160:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788201567.171162:0:23562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.171186:0:23562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09426e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201567.171471:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372160 00000100:00100000:3.0:1788201567.171476:0:22814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372160 00000100:00100000:3.0:1788201567.171546:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201567.171564:0:22814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23562:x1875064681372160:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788201567.171615:0:22814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23562:x1875064681372160:12345-0@lo:900:lod0001_rec0000.0 Request processed in 52us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.171621:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201567.171672:0:23562:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce0ba229c00 x1875064681372160/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201567.171695:0:23562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23562:1875064681372160:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788201567.171766:0:23562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875064681372288:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201567.171795:0:23562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201567.171813:0:23562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f079c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201567.171866:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372288 00000100:00100000:2.0:1788201567.171876:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372288 00000100:00100000:2.0:1788201567.171910:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201567.172025:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23562:x1875064681372288:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201567.172092:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23562:x1875064681372288:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 175us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201567.172099:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201567.172158:0:23562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875064681372288:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788201567.172199:0:23562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201567.177531:0:23562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201567.177615:0:23562:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201567.177620:0:23562:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788201567.183573:0:23535:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788201567.183617:0:23535:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc151814bb988 00100000:10000000:1.0:1788201567.183625:0:23535:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788201567.184486:0:23535:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201567.184515:0:23535:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201567.184535:0:23535:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788201567.184556:0:23535:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788201567.185435:0:23535:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201567.185647:0:23535:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788201567.221899:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788201567.478869:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201568.183581:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201568.248950:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 10000000:01000000:1.0:1788201568.501810:0:22800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201568.501818:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0aafde000 from 12 10000000:01000000:1.0:1788201568.501823:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201568.501882:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.501893:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.501903:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201568.501955:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201568.502021:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201568.502066:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201568.502144:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372416 00000100:00100000:0.0:1788201568.502151:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372416 00000100:00100000:0.0:1788201568.502204:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201568.502212:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+16:22800:x1875064681372416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201568.502224:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201568.502238:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721de3 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201568.502258:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201568.502268:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201568.502287:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83296400, rc 0) 00000100:00100000:0.0:1788201568.502331:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681372416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201568.502338:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201568.502466:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201568.502479:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.502487:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201568.502533:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201568.502565:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201568.502584:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f079c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201568.502934:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372544 00000100:00100000:2.0:1788201568.502940:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372544 00000100:00100000:2.0:1788201568.502974:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201568.502981:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681372544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201568.502994:0:22797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201568.503010:0:22797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201568.503013:0:22797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788201568.503244:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681372544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 263us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201568.503252:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:3.0:1788201568.503349:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201568.504104:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201568.504174:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201568.504182:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.504190:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201568.504199:0:22800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201568.504201:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b62a4800 from 12 10000000:01000000:1.0:1788201568.504204:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201568.504225:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.504242:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.504249:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201568.504266:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201568.504301:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201568.504387:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce098a99540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201568.504435:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372672 00000100:00100000:3.0:1788201568.504441:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372672 00000100:00100000:3.0:1788201568.504527:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201568.504536:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681372672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201568.504547:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201568.504558:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721df1 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201568.504575:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 18 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201568.504583:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 18 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201568.504591:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74400, rc 0) 00000100:00100000:3.0:1788201568.504632:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681372672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201568.504638:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201568.504712:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201568.504724:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.504731:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201568.504794:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201568.504821:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201568.505022:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce098a99540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201568.505127:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372800 00000100:00100000:0.0:1788201568.505131:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372800 00000100:00100000:0.0:1788201568.505152:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201568.505158:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681372800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201568.505171:0:22796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201568.505187:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201568.505190:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788201568.505268:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681372800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201568.505275:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201568.505373:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681372800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201568.505410:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201568.505416:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201568.505424:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201569.206347:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201569.270374:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788201569.526952:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201570.293856:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788201570.551776:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201571.324677:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788201571.575607:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201571.695710:0:23807:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788201572.342236:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 0 seconds 00000040:00080000:0.0:1788201572.350313:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201572.470873:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681372928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201572.470940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201572.475393:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1788201572.475399:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681372928 00000100:00080000:3.0:1788201572.475400:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788201572.475404:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788201572.475410:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681372928 00000100:00080000:3.0:1788201572.475417:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce0b9734000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201572.475440:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c89500 x1875064681373184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201572.475458:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201572.475462:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201572.475466:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201572.475469:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201572.475480:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788201572.475493:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788201572.475494:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681372928:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788201572.475500:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201572.475504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201572.475508:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201572.475535:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681373056:0@lo:400:kworker.0 00000004:00000024:2.0:1788201572.475537:0:22809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788201572.479999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201572.480169:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681373184:0@lo:38:kworker.0 00000100:00100000:3.0:1788201572.480215:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201572.480254:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681373312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201572.480294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201572.480321:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201572.480328:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681373440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201572.480358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201572.480398:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373056 00000100:00100000:3.0:1788201572.480405:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373056 00000100:00100000:3.0:1788201572.480448:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201572.480457:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:3647:x1875064681373056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201572.480650:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681372928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5157us (9706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201572.480661:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201572.480679:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:3647:x1875064681373056:12345-0@lo:400:kworker.0 Request processed in 221us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201572.480686:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373184 00000100:00100000:3.0:1788201572.480688:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201572.480697:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373184 00000100:00100000:2.0:1788201572.480717:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201572.480722:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875064681373184:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788201572.480726:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373312 00000100:00100000:3.0:1788201572.480732:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373312 00010000:00080000:2.0:1788201572.480764:0:22808:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000100:00100000:3.0:1788201572.480793:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373440 00000100:00100000:3.0:1788201572.480797:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373440 00000020:00000080:2.0:1788201572.480800:0:22808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721dff 00000100:00100000:3.0:1788201572.480815:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201572.480822:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681373312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201572.480859:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681373312:12345-0@lo:400:kworker.0 Request processed in 38us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201572.480865:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201572.480876:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201572.480882:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681373440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201572.480911:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681373440:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201572.480918:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201572.480971:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681372928:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788201572.481154:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0b6c88380 x1875064681373440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201572.481165:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681373440:0@lo:400:kworker.0 00010000:00080000:3.0:1788201572.481177:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0b6c88700 x1875064681373312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201572.481185:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681373312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201572.481210:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681373056:0@lo:400:kworker.0 00000004:00100000:2.0:1788201572.481260:0:22808:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788201572.481268:0:22808:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1788201572.511075:0:22808:0:(import.c:65:import_set_state_nolock()) ffff9ce09d401800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201572.511187:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681373184:12345-0@lo:38:kworker.0 Request processed in 30462us (30969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201572.511198:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788201572.511398:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788201572.511408:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788201572.511413:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788201572.511416:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b9734000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788201572.511436:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003c2c5a1d): req@ffff9ce0b6c8a300 x1875064681365760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201572.511461:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681373184:0@lo:38:kworker.0 00000100:00100000:2.0:1788201572.512643:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201572.512659:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681373568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201572.512714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201572.512771:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373568 00000100:00100000:2.0:1788201572.512777:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373568 00000100:00100000:2.0:1788201572.512827:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201572.512837:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681373568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201572.512867:0:22809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201572.512920:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875064681373568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201572.512927:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201572.512963:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681373568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201572.513362:0:22844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201572.513389:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201572.513492:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681365760 00000100:00100000:2.0:1788201572.513497:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681365760 00000100:00100000:2.0:1788201572.513531:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201572.513538:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22844:x1875064681365760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788201572.513616:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22844:x1875064681365760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201572.513623:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201572.513686:0:22844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875064681365760:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788201572.513716:0:22844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788201572.513776:0:22844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875064681373696:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201572.513804:0:22844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201572.513831:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201572.513988:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373696 00000100:00100000:0.0:1788201572.513993:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373696 00000100:00100000:0.0:1788201572.514025:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201572.514032:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22844:x1875064681373696:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201572.514154:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22844:x1875064681373696:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 122us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201572.514160:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201572.514184:0:22844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875064681373696:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201572.514249:0:22844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875064681373824:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201572.514282:0:22844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201572.514297:0:22844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201572.514308:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373824 00000100:00100000:0.0:1788201572.514311:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373824 00000100:00100000:0.0:1788201572.514328:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201572.514334:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22844:x1875064681373824:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201572.514378:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22844:x1875064681373824:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201572.514384:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201572.514407:0:22844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875064681373824:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788201572.514446:0:22844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201572.518897:0:22844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201572.518975:0:22844:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:0.0:1788201572.518981:0:22844:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788201572.604055:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201572.681709:0:23859:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201572.682040:0:23859:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201573.621959:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201573.686010:0:23909:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201573.686236:0:23909:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201574.653147:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201574.919666:0:23957:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc90c38f50 20000000:00000080:2.0:1788201574.919683:0:23957:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce0ab37a000 uarg=0000000000000000 20000000:01000000:2.0:1788201574.920191:0:23957:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788201574.920200:0:23957:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788201574.920206:0:23957:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788201574.935892:0:23958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788201574.936139:0:23957:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788201574.950160:0:23957:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788201574.953204:0:23957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201574.953230:0:23957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201574.953238:0:23957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721dab expref: 17 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201574.953265:0:23957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201574.953310:0:23957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721dab expref: 17 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201574.953322:0:23957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721dab expref: 17 pid: 22797 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201574.953440:0:23957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23957:1875064681373952:0@lo:104: 00000100:00100000:3.0:1788201574.953514:0:23957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201574.953610:0:23957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201574.953619:0:23957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 17 pid: 22796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201574.953627:0:23957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23957:1875064681374080:0@lo:104: 00000100:00100000:3.0:1788201574.953647:0:23957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201574.959474:0:23957:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201574.959899:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681373952 00000100:00100000:1.0:1788201574.959908:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681373952 00000100:00100000:1.0:1788201574.961149:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681374080 00000100:00100000:1.0:1788201574.961157:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681374080 00000100:00100000:1.0:1788201574.961180:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201574.961190:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:23957:x1875064681373952:12345-0@lo:104: 00010000:00010000:1.0:1788201574.961209:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201574.961384:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201574.961391:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:23957:x1875064681373952:12345-0@lo:104: Request processed in 203us (7876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.961415:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201574.961430:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201574.961436:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:23957:x1875064681374080:12345-0@lo:104: 00010000:00010000:1.0:1788201574.961445:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201574.961674:0:23957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23957:1875064681373952:0@lo:104: 00000100:00100000:3.0:1788201574.961684:0:23957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23957:1875064681374080:0@lo:104: 00010000:00010000:3.0:1788201574.961704:0:23957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.967177:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201574.967193:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.967206:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201574.967211:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.967222:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201574.967231:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201574.967255:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201574.967309:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.967316:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201574.967465:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681374208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201574.967531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201574.967664:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681374208 00000100:00100000:2.0:1788201574.967672:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681374208 00010000:00010000:2.0:1788201574.967705:0:22790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721dab expref: 18 pid: 22797 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201574.967765:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201574.967774:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:3647:x1875064681374208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201574.967787:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201574.967792:0:22790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721dab expref: 18 pid: 22797 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201574.967804:0:22790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721dab expref: 18 pid: 22797 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201574.967819:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a75800/0xf9b71aee44721db2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721dab expref: 18 pid: 22797 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201574.967835:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201574.968029:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.968038:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721dab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721db2 expref: -99 pid: 23535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.968050:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201574.968053:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.968059:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201574.968062:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.968080:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201574.968087:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201574.968093:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201574.968115:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.968122:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201574.968146:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.968153:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0a03ae000/0xf9b71aee44721ca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721caf expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.968167:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201574.968169:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201574.968171:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201574.968187:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681374336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201574.968217:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201574.968261:0:22788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788201574.968269:0:22788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788201574.968707:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681374336 00000100:00100000:0.0:1788201574.968713:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681374336 00010000:00010000:0.0:1788201574.968821:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 18 pid: 22796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201574.968838:0:22788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788201574.968846:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201574.968853:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:3644:x1875064681374336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201574.969026:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201574.969032:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 18 pid: 22796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969044:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 18 pid: 22796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969057:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254000/0xf9b71aee44721caf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721ca8 expref: 18 pid: 22796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969095:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969103:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969118:0:22788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969125:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969132:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969138:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969144:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201574.969148:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969156:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969172:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201574.969182:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201574.969224:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:3644:x1875064681374336:12345-0@lo:103:ldlm_bl.0 Request processed in 371us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201574.969238:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201574.969279:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681374336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201574.969646:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788201574.969655:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:23957:x1875064681374080:12345-0@lo:104: Request processed in 8218us (16006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.969664:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788201574.970205:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201574.972597:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+16:3647:x1875064681374208:12345-0@lo:103:ldlm_bl.0 Request processed in 4816us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201574.972625:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788201574.972683:0:23957:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201574.972695:0:23957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201574.972703:0:23957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74000/0xf9b71aee44721e06 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201574.979819:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681374208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201575.541925:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201560/real 1788201560] req@ffff9ce0ba229180 x1875064681366784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.541965:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0ba229180 x1875064681366784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.541975:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201560/real 1788201560] req@ffff9ce0ba229880 x1875064681366912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.541987:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0ba229880 x1875064681366912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201575.542011:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5be9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201575.542112:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201575.542117:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366784:0@lo:8:kworker.0 00000100:00080000:1.0:1788201575.542124:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788201575.543224:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681374464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.543321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201575.545038:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201575.545049:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201575.545055:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5be9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201575.545928:0:493:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:3.0:1788201575.545939:0:493:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201575.545949:0:493:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce0a5be9000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201575.546015:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c89180 x1875064681374592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201575.546035:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201575.546040:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201575.546042:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201575.546046:0:493:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:3.0:1788201575.546049:0:493:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201575.546054:0:493:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce0a1aa3800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201575.546079:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0b6c89c00 x1875064681374720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201575.546126:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201575.546141:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681374848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.546215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201575.546253:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681374848 00000100:00100000:3.0:1788201575.546262:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681374848 00000100:00100000:3.0:1788201575.546322:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201575.546333:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681374848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.546396:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875064681374848:12345-0@lo:400:kworker.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201575.546421:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788201575.546469:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0b6c8b100 x1875064681374848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201575.546485:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875064681374848:0@lo:400:kworker.0 00000100:00080000:3.0:1788201575.546518:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201575.546521:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201575.546524:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201575.546527:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201575.546535:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681374976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.546631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201575.547513:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201575.547522:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681366912:0@lo:8:kworker.0 00000100:00100000:1.0:1788201575.547567:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681374592:0@lo:8:kworker.0 00000400:00000100:1.0:1788201575.547611:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681374592 offset 0 length 520: 4 00000100:00100000:1.0:1788201575.547651:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681374720:0@lo:8:kworker.0 00000400:00000100:1.0:1788201575.547807:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681374720 offset 0 length 520: 4 00000100:00100000:3.0:1788201575.548614:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201575.548626:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681375104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.548681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201575.548711:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681375104 00000100:00100000:3.0:1788201575.548718:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681375104 00000100:00100000:3.0:1788201575.548785:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201575.549113:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681375104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.549191:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681375104:12345-0@lo:400:kworker.0 Request processed in 395us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201575.549200:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788201575.549280:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6ab800 x1875064681375104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201575.549296:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681375104:0@lo:400:kworker.0 00000100:00080000:3.0:1788201575.550386:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201575.550395:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201575.550398:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201575.550419:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201575.560904:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681374464 00000100:00100000:1.0:1788201575.560904:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681374976 00000100:00100000:2.0:1788201575.560924:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681374464 00000100:00100000:1.0:1788201575.560924:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681374976 00000100:00100000:1.0:1788201575.561016:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201575.561031:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681374976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201575.561222:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681374976:12345-0@lo:400:kworker.0 Request processed in 195us (14590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201575.561240:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201575.561451:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201575.561467:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681374464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201575.561524:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681374464:12345-0@lo:400:kworker.0 Request processed in 60us (18199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201575.561531:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201575.561594:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681374464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.561682:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681374976:0@lo:400:kworker.0 00010000:00010000:1.0:1788201575.673025:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201576.629915:0:22800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201576.629925:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0aafde000 from 13 10000000:01000000:1.0:1788201576.629933:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201576.630000:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.630015:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.630060:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.630095:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.630190:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.630252:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.630293:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681375232 00000100:00100000:2.0:1788201576.630304:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681375232 00000100:00100000:2.0:1788201576.630385:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201576.630397:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0391c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+16:22800:x1875064681375232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201576.630415:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201576.630433:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721e0d expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.630463:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 17 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.630476:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 17 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.630488:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03af600, rc 0) 00000100:00100000:2.0:1788201576.630552:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0391c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681375232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.630572:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201576.630825:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.630844:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.630946:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.631046:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.631087:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.631161:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201576.633220:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681375360 00000100:00100000:3.0:1788201576.633314:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681375360 00000100:00100000:0.0:1788201576.633471:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201576.633484:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681375360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201576.633720:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681375360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.633728:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201576.633900:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.633968:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.634037:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.634080:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201576.634311:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681375488 00000100:00100000:3.0:1788201576.634318:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681375488 00000100:00100000:3.0:1788201576.634362:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201576.634371:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681375488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201576.634522:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681375488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201576.634531:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201576.637534:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201576.639214:0:24027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788201576.639469:0:22800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788201576.639501:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201576.639515:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.639545:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.639556:0:22800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201576.639559:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b62a4800 from 13 10000000:01000000:1.0:1788201576.639563:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201576.639605:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.639613:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.639626:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.639653:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.640205:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.640308:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.640347:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681375616 00000100:00100000:2.0:1788201576.640353:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681375616 00000100:00100000:2.0:1788201576.640403:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201576.640412:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+17:22800:x1875064681375616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201576.640426:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201576.640441:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721e1b expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.640464:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 18 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.640473:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 18 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.640481:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03ae600, rc 0) 00000100:00100000:2.0:1788201576.640551:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681375616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.640557:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201576.640650:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.640663:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.641119:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.641202:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.641239:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.641336:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.641380:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681375744 00000100:00100000:0.0:1788201576.641386:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681375744 00000100:00100000:0.0:1788201576.641457:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201576.641467:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681375744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201576.641615:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681375744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.641623:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201576.641708:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.641758:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.641818:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.642248:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba110c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.642319:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681375872 00000100:00100000:2.0:1788201576.642325:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681375872 00000100:00100000:2.0:1788201576.642351:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788201576.642359:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681375872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201576.642463:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:22800:x1875064681375872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.642471:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201576.642562:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681375872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201576.643716:0:24028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788201576.644482:0:22800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788201576.644515:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201576.644528:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.644543:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.694108:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201577.589944:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681376000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201577.590028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201577.590102:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681376000 00000100:00100000:2.0:1788201577.590111:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681376000 00000100:00100000:2.0:1788201577.590162:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201577.590171:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681376000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201577.590213:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201577.590255:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681376000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201577.590262:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201577.590316:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681376000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201577.596435:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201567/real 1788201567] req@ffff9ce0b6c89f80 x1875064681369344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201577.596471:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0b6c89f80 x1875064681369344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201577.596499:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201567/real 1788201567] req@ffff9ce0ba22b800 x1875064681369088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201577.596512:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0ba22b800 x1875064681369088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201577.596535:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201577.597765:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201577.597772:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201577.597775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201577.597778:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201577.597813:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201577.597816:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201577.597818:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201577.597822:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201577.597826:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201577.597833:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1788201577.597839:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201577.597846:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce087eb6000 using connection 192.168.203.102@tcp/0@lo 00000100:00080000:0.0:1788201577.597873:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201577.597879:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681369344:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201577.597880:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a9f80 x1875064681376640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201577.597889:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201577.597902:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:3.0:1788201577.597904:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788201577.597906:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681369088:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788201577.597907:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201577.597909:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201577.597911:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201577.597913:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201577.597916:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201577.597918:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201577.597921:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1788201577.597924:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201577.597927:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce0b94fb800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201577.598391:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681376640:0@lo:8:kworker.0 00000400:00000100:0.0:1788201577.598457:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681376640 offset 0 length 520: 4 00000100:00100000:0.0:1788201577.598511:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681376128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201577.598544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.599286:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6abb80 x1875064681376896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201577.599331:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681376256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.599383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.599429:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681376256 00000100:00100000:3.0:1788201577.599437:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681376256 00000100:00100000:3.0:1788201577.599489:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201577.599499:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce088958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:3647:x1875064681376256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.599694:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce088958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:3647:x1875064681376256:12345-0@lo:400:kworker.0 Request processed in 195us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.599701:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201577.599765:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681376256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.599803:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681376512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.599831:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.599855:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201577.599862:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681376384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.599887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.599924:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681376384 00000100:00100000:3.0:1788201577.599928:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681376384 00000100:00100000:3.0:1788201577.599957:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201577.599964:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681376384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.599999:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681376384:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.600005:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201577.600022:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681376128 00000100:00100000:3.0:1788201577.600026:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681376128 00000100:00100000:3.0:1788201577.600059:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681376512 00000100:00100000:3.0:1788201577.600062:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681376512 00000100:00100000:3.0:1788201577.600075:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201577.600081:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681376128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201577.600111:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788201577.600146:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875064681376128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.600152:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201577.600163:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201577.600168:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681376512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.600193:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681376512:12345-0@lo:400:kworker.0 Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.600209:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788201577.600238:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6a9180 x1875064681376384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201577.600250:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681376384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201577.600716:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681376512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201577.601711:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681376128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201577.601725:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681376768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201577.601797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201577.601861:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681376768 00000100:00100000:0.0:1788201577.601867:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681376768 00000100:00100000:0.0:1788201577.601911:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201577.601920:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681376768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201577.601969:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681376768:12345-0@lo:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201577.601983:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201577.602015:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681376896:0@lo:8:kworker.0 00000400:00000100:0.0:1788201577.602044:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875064681376896 offset 0 length 520: 4 00010000:00080000:0.0:1788201577.602096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6a9880 x1875064681376768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201577.602107:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681376768:0@lo:400:kworker.0 00010000:00010000:1.0:1788201577.718214:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201578.625192:0:23536:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788201578.742370:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201579.447470:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201579.767438:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201580.837528:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.879222:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201582.278891:0:24307:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201582.278894:0:24307:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788201582.278896:0:24307:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788201582.279009:0:24307:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9cdf8376a000 00000020:01000004:3.0:1788201582.279035:0:24307:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788201582.279049:0:24307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201582.279061:0:24307:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cdf821d0000) 00000020:00000080:3.0:1788201582.279080:0:24307:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788201582.339482:0:24307:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788201582.341070:0:24307:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788201582.341441:0:24307:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788201582.341604:0:24307:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788201582.341771:0:24307:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788201582.341926:0:24307:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788201582.342251:0:24307:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788201582.344948:0:24307:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201582.345191:0:24307:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788201582.345207:0:24307:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201582.345220:0:24307:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf9b71aee44721e30 00000020:01000004:1.0:1788201582.345228:0:24307:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788201582.345250:0:24307:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788201582.345253:0:24307:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788201582.345258:0:24307:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788201582.345262:0:24307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788201582.345273:0:24307:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ce0a64399c0) 00000020:00000080:1.0:1788201582.345287:0:24307:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788201582.346682:0:24307:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201582.346933:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201582.346939:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788201582.347785:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201582.347794:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788201582.347958:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201582.347964:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788201582.351267:0:24307:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201582.351944:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788201582.351954:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788201582.354093:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788201582.354108:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788201582.398120:0:24307:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201582.398357:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201582.398363:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788201582.399904:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201582.399916:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788201582.401769:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201582.401781:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788201582.404642:0:24307:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201582.404822:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788201582.404829:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788201582.409334:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201582.409348:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788201582.467051:0:24307:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201582.467220:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201582.467226:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788201582.468594:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201582.468604:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788201582.469283:0:24307:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788201582.469310:0:24307:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788201582.469317:0:24307:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788201582.494270:0:24307:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201582.494369:0:24307:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788201582.494373:0:24307:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201582.494375:0:24307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201582.494376:0:24307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201582.494377:0:24307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201582.494378:0:24307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201582.494379:0:24307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201582.494380:0:24307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201582.494381:0:24307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201582.494382:0:24307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201582.494385:0:24307:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788201582.494387:0:24307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201582.494388:0:24307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201582.494393:0:24307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201582.494394:0:24307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201582.494394:0:24307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201582.494395:0:24307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201582.494396:0:24307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201582.494396:0:24307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201582.494397:0:24307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201582.494429:0:24307:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788201582.494455:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377024:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201582.494546:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201582.494770:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377024 00000100:00100000:2.0:1788201582.494780:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377024 00000100:00100000:2.0:1788201582.494844:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201582.494862:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce088959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:24307:x1875064681377024:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201582.494916:0:22796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201582.494920:0:22796:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788201582.494925:0:22796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201582.495080:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201582.495869:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce088959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:24307:x1875064681377024:12345-0@lo:253:mount.lustre.0 Request processed in 1005us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.495880:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201582.495889:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377024:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201582.495904:0:24307:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788201582.495907:0:24307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201582.495909:0:24307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201582.495910:0:24307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201582.495912:0:24307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201582.495913:0:24307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201582.495915:0:24307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201582.495917:0:24307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201582.495918:0:24307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201582.495920:0:24307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201582.495967:0:24307:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cdf8376a000 from lustre-OST0000 10000000:01000000:0.0:1788201582.496003:0:24307:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788201582.496006:0:24307:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201582.496296:0:24307:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0a6580000 local copy 00010000:00010000:0.0:1788201582.496309:0:24307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201582.496424:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201582.496462:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.496510:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201582.496578:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377152 00000100:00100000:2.0:1788201582.496585:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377152 00000100:00100000:2.0:1788201582.496676:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201582.496686:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:24307:x1875064681377152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201582.496802:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:24307:x1875064681377152:12345-0@lo:501:mount.lustre.0 Request processed in 117us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201582.496821:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201582.497243:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377152:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788201582.497280:0:24307:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201582.497301:0:24307:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201582.497309:0:24307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.497318:0:24307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201582.497356:0:24307:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cdf8376a000 10000000:01000000:0.0:1788201582.497361:0:24307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201582.497367:0:24307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201582.497370:0:24307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201582.497375:0:24307:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788201582.497378:0:24307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201582.497403:0:24307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.497412:0:24307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.497423:0:24307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201582.497449:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201582.497478:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.498144:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201582.498267:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377280 00000100:00100000:3.0:1788201582.498274:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377280 00000100:00100000:1.0:1788201582.498397:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201582.498405:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+18:24307:x1875064681377280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201582.498417:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201582.498432:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721e3e expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.498458:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721e3e expref: 19 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.498470:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254e00/0xf9b71aee44721e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e3e expref: 19 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.498479:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254e00, rc 0) 00000100:00100000:1.0:1788201582.498569:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377280:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.498590:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201582.498665:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201582.498679:0:24307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e45 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.498694:0:24307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721e45 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201582.500449:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788201582.501512:0:24307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201582.505129:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788201582.505190:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788201582.505205:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788201582.505218:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788201582.505231:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788201582.505243:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788201582.505261:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788201582.505276:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788201582.505289:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788201582.505302:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788201582.505314:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788201582.505489:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788201582.505520:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788201582.505527:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788201582.505632:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201582.505700:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.505835:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9631840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201582.508313:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377408 00000100:00100000:1.0:1788201582.508337:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377408 00000100:00100000:1.0:1788201582.508491:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201582.508503:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201582.508734:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377408:12345-0@lo:501:mount.lustre.0 Request processed in 234us (3034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.508765:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201582.508899:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201582.508944:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201582.508986:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.509040:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9631840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201582.509481:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377536 00000100:00100000:1.0:1788201582.509487:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377536 00000100:00100000:1.0:1788201582.509557:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201582.509565:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201582.513276:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377536:12345-0@lo:503:mount.lustre.0 Request processed in 3703us (4280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.513290:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201582.513559:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201582.514139:0:24307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201582.514217:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201582.514270:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.514362:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9631840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201582.514558:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377664 00000100:00100000:1.0:1788201582.514565:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377664 00000100:00100000:1.0:1788201582.514672:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201582.514682:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201582.515279:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377664:12345-0@lo:502:mount.lustre.0 Request processed in 596us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.515288:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201582.515405:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201582.515617:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788201582.515644:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788201582.515658:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788201582.515672:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788201582.515686:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788201582.515700:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788201582.515714:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788201582.515727:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788201582.515761:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788201582.515778:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788201582.515792:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788201582.515834:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788201582.515863:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201582.515903:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.519153:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b9631840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201582.519199:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377792 00000100:00100000:2.0:1788201582.519208:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377792 00000100:00100000:2.0:1788201582.519258:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201582.519268:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201582.519626:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377792:12345-0@lo:502:mount.lustre.0 Request processed in 359us (3721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.519636:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201582.520974:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201582.521068:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788201582.521082:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788201582.522669:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201582.522678:0:24324:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788201582.522682:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201582.522685:0:24324:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788201582.522689:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201582.522701:0:24324:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ce0bf450000) 00000020:00000080:2.0:1788201582.522721:0:24324:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788201582.522729:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201582.523008:0:24324:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cdf8376a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788201582.523029:0:24324:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788201582.523049:0:24324:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf9b71aee44721e53 00010000:00010000:3.0:1788201582.532529:0:24324:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788201582.533084:0:24324:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788201582.540733:0:24324:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788201582.550769:0:24324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788201582.550784:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201582.550792:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201582.550793:0:24324:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788201582.550797:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201582.550799:0:24324:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788201582.550809:0:24324:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201582.550811:0:24324:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201582.550813:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201582.550816:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201582.550817:0:24324:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201582.550820:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201582.550824:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201582.550825:0:24324:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201582.550828:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201582.550830:0:24324:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201582.550832:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201582.550835:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201582.550836:0:24324:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201582.550838:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201582.550841:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201582.550842:0:24324:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201582.550845:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201582.550879:0:24324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201582.550882:0:24324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201582.550883:0:24324:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201582.550886:0:24324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788201582.551067:0:24307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788201582.551108:0:24307:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201582.551124:0:24307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e45 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.551136:0:24307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83297000/0xf9b71aee44721e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e45 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201582.551145:0:24307:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cdf8376a000 from 1 10000000:01000000:2.0:1788201582.551148:0:24307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201582.551181:0:24307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.551189:0:24307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.551200:0:24307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201582.551227:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201582.551299:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201582.551345:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09426e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201582.555168:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681377920 00000100:00100000:3.0:1788201582.555181:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681377920 00000100:00100000:3.0:1788201582.555236:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788201582.555246:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:24307:x1875064681377920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201582.555262:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201582.555279:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721e5a expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201582.555306:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 20 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201582.555317:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 20 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201582.555334:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74800, rc 0) 00000100:00100000:3.0:1788201582.555404:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681377920:12345-0@lo:101:mount.lustre.0 Request processed in 160us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201582.555411:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201582.557215:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681377920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201582.557243:0:24307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.557272:0:24307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201582.559315:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788201582.559615:0:24307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201582.559996:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788201582.560036:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788201582.560067:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788201582.560083:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788201582.560097:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788201582.560110:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788201582.560135:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788201582.560152:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788201582.560165:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788201582.560178:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788201582.560191:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788201582.560209:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788201582.560214:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788201582.560289:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201582.560355:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201582.560397:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201582.560492:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378048 00000100:00100000:1.0:1788201582.560499:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378048 00000100:00100000:1.0:1788201582.560543:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201582.560551:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201582.560660:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378048:12345-0@lo:501:mount.lustre.0 Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.560667:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201582.560894:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201582.560927:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201582.560965:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201582.561033:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81990480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201582.562456:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378176 00000100:00100000:0.0:1788201582.562465:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378176 00000100:00100000:0.0:1788201582.562518:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201582.562529:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201582.562679:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378176:12345-0@lo:503:mount.lustre.0 Request processed in 152us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.562686:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201582.562839:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201582.563248:0:24307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201582.563323:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201582.563371:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.563399:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201582.563575:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378304 00000100:00100000:2.0:1788201582.563583:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378304 00000100:00100000:2.0:1788201582.563615:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201582.563627:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201582.563712:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378304:12345-0@lo:502:mount.lustre.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.563719:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201582.563965:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201582.564200:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788201582.564227:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788201582.564238:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788201582.564249:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788201582.564259:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788201582.564269:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788201582.564278:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788201582.564287:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788201582.564297:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788201582.564306:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788201582.564316:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788201582.564335:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201582.564370:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.564433:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201582.564554:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378432 00000100:00100000:2.0:1788201582.564560:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378432 00000100:00100000:2.0:1788201582.564595:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201582.564602:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201582.564727:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378432:12345-0@lo:502:mount.lustre.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.564734:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201582.565180:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201582.565237:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788201582.565246:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788201582.567235:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201582.567249:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.567252:0:24328:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201582.567259:0:24328:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cdf8376a000 00000020:00000080:0.0:1788201582.567261:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201582.567269:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201582.567272:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.567274:0:24328:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788201582.567276:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201582.567279:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.567280:0:24328:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201582.567283:0:24328:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cdf8376a000 00000020:00000080:0.0:1788201582.567285:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201582.567497:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201582.567502:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.567504:0:24328:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788201582.567506:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201582.567509:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.567510:0:24328:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201582.567514:0:24328:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cdf8376a000 00000020:00000080:0.0:1788201582.567516:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201582.573351:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201582.573362:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.573365:0:24328:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788201582.573368:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201582.573373:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.573374:0:24328:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788201582.573380:0:24328:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cdf8376a000 00000020:00000080:0.0:1788201582.573383:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201582.573452:0:24328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201582.573455:0:24328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201582.573457:0:24328:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788201582.573460:0:24328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788201582.575328:0:24307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788201582.575369:0:24307:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201582.577784:0:24307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201582.577802:0:24307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201582.577871:0:24307:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201582.577875:0:24307:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cdf8376a000 10000000:01000000:3.0:1788201582.577878:0:24307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cdf8376a000 10000000:01000000:3.0:1788201582.577882:0:24307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201582.577888:0:24307:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cdf8376a000 from 1 10000000:01000000:3.0:1788201582.577892:0:24307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201582.577925:0:24307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee44721e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201582.577935:0:24307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee44721e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201582.577947:0:24307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee44721e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201582.577972:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201582.578407:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.578485:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201582.578525:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378560 00000100:00100000:1.0:1788201582.578533:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378560 00000100:00100000:1.0:1788201582.578581:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201582.578591:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:24307:x1875064681378560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201582.578604:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201582.578619:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255800/0xf9b71aee44721e6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721e68 expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.578641:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255800/0xf9b71aee44721e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721e68 expref: 21 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.578652:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255800/0xf9b71aee44721e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e68 expref: 21 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.578661:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255800, rc 0) 00000100:00100000:1.0:1788201582.578697:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681378560:12345-0@lo:101:mount.lustre.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.578704:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201582.578885:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201582.578908:0:24307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee44721e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e6f expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201582.578918:0:24307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee44721e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721e6f expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201582.584777:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788201582.586205:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788201582.586491:0:24307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201582.586680:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788201582.586706:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788201582.586723:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788201582.587037:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788201582.587061:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788201582.587076:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788201582.587088:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788201582.587100:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788201582.587111:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788201582.587124:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788201582.587137:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788201582.587167:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788201582.587183:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788201582.587194:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788201582.587206:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788201582.587217:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788201582.587228:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788201582.587239:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788201582.587251:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788201582.587263:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788201582.587276:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788201582.587290:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788201582.587304:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788201582.587318:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788201582.587331:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788201582.587343:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788201582.587357:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788201582.587390:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788201582.587406:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788201582.587419:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788201582.587429:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788201582.587440:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788201582.587453:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788201582.587466:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788201582.587479:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788201582.587492:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788201582.587504:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788201582.587517:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788201582.587528:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788201582.587538:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788201582.587549:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788201582.587559:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788201582.587569:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788201582.587592:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788201582.587605:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788201582.587615:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788201582.587627:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788201582.587639:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788201582.588451:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788201582.588488:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788201582.588509:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788201582.588514:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788201582.588619:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201582.588684:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.588898:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b96319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201582.589219:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378688 00000100:00100000:2.0:1788201582.589227:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378688 00000100:00100000:2.0:1788201582.589277:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788201582.589286:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681378688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201582.589407:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681378688:12345-0@lo:501:mount.lustre.0 Request processed in 122us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.589415:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201582.590099:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201582.590142:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201582.590196:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.590222:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b96319c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201582.591498:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378816 00000100:00100000:3.0:1788201582.591508:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378816 00000100:00100000:3.0:1788201582.591556:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201582.591578:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681378816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201582.591718:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681378816:12345-0@lo:503:mount.lustre.0 Request processed in 142us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201582.591725:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788201582.591821:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201582.592283:0:24307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201582.592383:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201582.592440:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.592477:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09455c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201582.592499:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681378944 00000100:00100000:0.0:1788201582.592504:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681378944 00000100:00100000:0.0:1788201582.592543:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201582.592552:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681378944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201582.597354:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681378944:12345-0@lo:502:mount.lustre.0 Request processed in 4793us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.598096:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681378944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201582.599483:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000040:00080000:1.0:1788201582.602344:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788201582.602392:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788201582.602411:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788201582.602429:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788201582.602470:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788201582.602488:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788201582.602505:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788201582.602518:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788201582.602531:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788201582.602546:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788201582.602562:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788201582.602577:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788201582.602591:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788201582.602605:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788201582.602623:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788201582.602641:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788201582.602661:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788201582.602679:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788201582.602700:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788201582.602762:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788201582.602781:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788201582.602794:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788201582.602820:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788201582.602837:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788201582.602852:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788201582.602866:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788201582.602878:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788201582.602889:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788201582.602901:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788201582.602912:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788201582.602923:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788201582.602936:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788201582.602950:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788201582.602962:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788201582.602975:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788201582.603005:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788201582.603039:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788201582.603062:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788201582.603075:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788201582.603086:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788201582.603096:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788201582.603108:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788201582.603121:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788201582.603132:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788201582.603146:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788201582.603167:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788201582.603186:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788201582.603200:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788201582.603258:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681379072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201582.603354:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201582.603401:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aafc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201582.604079:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379072 00000100:00100000:0.0:1788201582.604087:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379072 00000100:00100000:0.0:1788201582.604149:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201582.604160:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681379072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201582.604304:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681379072:12345-0@lo:502:mount.lustre.0 Request processed in 145us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.604313:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201582.604337:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681379072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201582.604530:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788201582.604608:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788201582.604642:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681379200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201582.604682:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.604851:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201582.605724:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379200 00000100:00100000:0.0:1788201582.605733:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379200 00000100:00100000:0.0:1788201582.605792:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788201582.605801:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681379200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201582.605953:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681379200:12345-0@lo:502:mount.lustre.0 Request processed in 152us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.605981:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201582.606237:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681379200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201582.606302:0:24307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788201582.606314:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788201582.610348:0:24334:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788201582.610372:0:24334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cdf820c0000) 00000020:00000080:1.0:1788201582.610394:0:24334:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788201582.610572:0:24334:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cdf8376a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201582.610576:0:24334:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cdf8376a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201582.610579:0:24334:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cdf8376a000 3 00010000:00080000:1.0:1788201582.610605:0:24334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf821df000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201582.612225:0:24334:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788201582.612311:0:24334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788201582.612354:0:24334:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201582.612366:0:24334:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf9b71aee44721e7d 00000100:00080000:1.0:1788201582.612375:0:24334:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201582.612382:0:24334:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cdf821df000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201582.612418:0:24334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf682a00 x1875064681379328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201582.612450:0:24334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201582.612510:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201582.612514:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201582.612516:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201582.612520:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201582.612663:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681379328:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201582.612937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.613027:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681379456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201582.613067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201582.613096:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201582.613100:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201582.613102:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788201582.613105:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201582.613415:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681379840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201582.613445:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.613916:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379328 00000100:00100000:3.0:1788201582.613923:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379328 00000100:00100000:1.0:1788201582.614436:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379840 00000100:00100000:1.0:1788201582.614441:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379840 00000100:00100000:1.0:1788201582.614516:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201582.614526:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681379840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201582.614588:0:22804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788201582.614597:0:22804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788201582.614613:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681379840:12345-0@lo:400:kworker.0 Request processed in 87us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.614622:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201582.614626:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379456 00000100:00100000:3.0:1788201582.614634:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379456 00000100:00100000:1.0:1788201582.614643:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201582.614649:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875064681379328:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201582.614669:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788201582.614671:0:22802:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000100:00100000:3.0:1788201582.614682:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681379456:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1788201582.614708:0:22802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf9b71aee44721e84 00000004:00100000:1.0:1788201582.614723:0:22802:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788201582.614730:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681379456:12345-0@lo:400:kworker.0 Request processed in 52us (1661us total) trans 0 rc 0/0 00000100:00080000:1.0:1788201582.614794:0:22802:0:(import.c:65:import_set_state_nolock()) ffff9ce0ab2db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201582.614846:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875064681379328:12345-0@lo:38:llog_process_th.0 Request processed in 196us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201582.614862:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788201582.614898:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf680700 x1875064681379840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201582.614909:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201582.614911:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681379840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201582.614936:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681379584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201582.614964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.614996:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201582.615003:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681379712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201582.615053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201582.615073:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379584 00000100:00100000:2.0:1788201582.615079:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379584 00000100:00100000:3.0:1788201582.615100:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379712 00000100:00100000:3.0:1788201582.615106:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379712 00000100:00100000:2.0:1788201582.615107:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201582.615118:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681379584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201582.615137:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201582.615147:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681379712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201582.615174:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681379584:12345-0@lo:400:kworker.0 Request processed in 47us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.615182:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201582.615190:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681379712:12345-0@lo:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201582.615197:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201582.615218:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681379712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201582.615243:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681379456:0@lo:400:kworker.0 00010000:00080000:2.0:1788201582.615253:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf683800 x1875064681379584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788201582.615276:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf682a00 x1875064681379328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201582.615295:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201582.615302:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788201582.615310:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201582.615315:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201582.615317:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821df000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201582.615323:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875064681379328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201582.615420:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681379584:0@lo:400:kworker.0 00000020:01000004:3.0:1788201582.615801:0:24334:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788201582.615815:0:24334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9cdf821d3380) 00000020:00000080:3.0:1788201582.615833:0:24334:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788201582.615964:0:24334:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cdf8376a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201582.615968:0:24334:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cdf8376a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201582.615970:0:24334:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cdf8376a000 3 00010000:00080000:3.0:1788201582.615999:0:24334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf821da000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1788201582.618991:0:24334:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788201582.619563:0:24334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788201582.619608:0:24334:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201582.619621:0:24334:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf9b71aee44721e92 00000100:00080000:3.0:1788201582.619631:0:24334:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201582.619637:0:24334:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cdf821da000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201582.619671:0:24334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6aad80 x1875064681379968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201582.619772:0:24334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788201582.619795:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201582.619799:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201582.619802:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201582.619811:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201582.619815:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201582.619817:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201582.619820:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201582.619823:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201582.619865:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681379968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201582.620629:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201582.621143:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681379968 00000100:00100000:2.0:1788201582.621151:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681379968 00000100:00100000:2.0:1788201582.621197:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201582.621205:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681379968:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201582.621234:0:22805:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1788201582.621267:0:22805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf9b71aee44721e99 00000004:00100000:2.0:1788201582.621282:0:22805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:1.0:1788201582.621309:0:24334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00080000:2.0:1788201582.621313:0:22805:0:(import.c:65:import_set_state_nolock()) ffff9cdf82749000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201582.621370:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875064681379968:12345-0@lo:38:llog_process_th.0 Request processed in 165us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.621377:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788201582.621417:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce0bf6aad80 x1875064681379968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201582.621428:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201582.621436:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788201582.621442:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788201582.621446:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788201582.621449:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821da000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201582.621455:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875064681379968:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788201582.622857:0:24307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788201582.622901:0:24307:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201582.622925:0:24307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee44721e68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e6f expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.622937:0:24307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75e00/0xf9b71aee44721e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721e6f expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201582.622985:0:24307:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201582.622987:0:24307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201582.622989:0:24307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201582.622990:0:24307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201582.622991:0:24307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201582.622993:0:24307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201582.622994:0:24307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201582.622996:0:24307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201582.622997:0:24307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201582.623002:0:24307:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788201582.623004:0:24307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201582.623005:0:24307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201582.623007:0:24307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201582.623023:0:24307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201582.623025:0:24307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201582.623026:0:24307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201582.623027:0:24307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201582.623028:0:24307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201582.623029:0:24307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201582.623049:0:24307:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788201582.623067:0:24307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681380096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201582.623122:0:24307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.623157:0:24307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09015f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201582.623176:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380096 00000100:00100000:0.0:1788201582.623181:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380096 00000100:00100000:0.0:1788201582.623220:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201582.623228:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681380096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201582.623253:0:22797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201582.623266:0:22797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788201582.626076:0:22797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201582.626125:0:22797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201582.626427:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:24307:x1875064681380096:12345-0@lo:253:mount.lustre.0 Request processed in 3194us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.626440:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201582.626474:0:24307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:24307:1875064681380096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201582.626492:0:24307:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201582.626502:0:24307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201582.626503:0:24307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201582.626505:0:24307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201582.626506:0:24307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201582.626507:0:24307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201582.626508:0:24307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201582.626509:0:24307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201582.626510:0:24307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201582.626512:0:24307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201582.626527:0:24307:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788201582.627147:0:22819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201582.627152:0:22819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201582.627174:0:22819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.627190:0:22819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 20 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.627198:0:22819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 20 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.627205:0:22819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.627244:0:22819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 20 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.627260:0:22819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 20 pid: 22798 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201582.627275:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681380224:0@lo:104: 00000100:00100000:1.0:1788201582.627325:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201582.628177:0:22819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 20 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.628194:0:22819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 20 pid: 22796 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201582.628221:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf681500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681380352:0@lo:104: 00000100:00100000:1.0:1788201582.628262:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201582.628299:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b5aaf240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201582.628454:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380224 00000100:00100000:3.0:1788201582.628462:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380224 00000100:00100000:2.0:1788201582.628479:0:22786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201582.628496:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380352 00000100:00100000:3.0:1788201582.628500:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380352 00000100:00100000:2.0:1788201582.628501:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201582.628515:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:22819:x1875064681380224:12345-0@lo:104: 00010000:00010000:2.0:1788201582.628528:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.628666:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201582.628673:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:22819:x1875064681380224:12345-0@lo:104: Request processed in 163us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.628681:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201582.628699:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201582.628706:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681380352:12345-0@lo:104: 00010000:00010000:2.0:1788201582.628714:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.628785:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201582.628792:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681380352:12345-0@lo:104: Request processed in 86us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.628799:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788201582.628846:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201582.628852:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.628866:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255c00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201582.628870:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.628879:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201582.628887:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201582.628892:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201582.628929:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.628936:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201582.628958:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201582.628965:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681380480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201582.628968:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721df1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721df8 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.628985:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201582.628988:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.628993:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:2.0:1788201582.628997:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201582.629004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201582.629028:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201582.629035:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201582.629041:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201582.629064:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.629071:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201582.629088:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.629096:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255a00/0xf9b71aee44721de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721dea expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201582.629108:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681380608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201582.629110:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201582.629114:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201582.629116:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201582.629144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201582.629195:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380480 00000100:00100000:3.0:1788201582.629199:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380480 00010000:00010000:3.0:1788201582.629216:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 21 pid: 22798 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201582.629257:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201582.629348:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681380224:0@lo:104: 00000100:00100000:3.0:1788201582.629360:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380608 00000100:00100000:0.0:1788201582.629361:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf681500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681380352:0@lo:104: 00000100:00100000:3.0:1788201582.629366:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380608 00010000:00010000:3.0:1788201582.629385:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 22 pid: 22796 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629386:0:22819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201582.629424:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201582.629432:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:3647:x1875064681380480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201582.629445:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201582.629451:0:22790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 22 pid: 22798 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.629461:0:22790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 22 pid: 22798 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.629508:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721df8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721df1 expref: 22 pid: 22798 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201582.629515:0:23959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788201582.629522:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201582.629526:0:23959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3644:x1875064681380608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201582.629538:0:23959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201582.629544:0:23959:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 21 pid: 22796 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629562:0:23959:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 21 pid: 22796 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201582.629571:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3647:x1875064681380480:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (566us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201582.629576:0:23959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83296400/0xf9b71aee44721dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721de3 expref: 21 pid: 22796 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201582.629584:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788201582.629593:0:23959:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629603:0:23959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201582.629616:0:23959:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002464908s 00010000:00010000:0.0:1788201582.629621:0:23959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629629:0:23959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629636:0:23959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629642:0:23959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629647:0:23959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201582.629651:0:23959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629658:0:23959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201582.629727:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681380480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201582.629800:0:23959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.629801:0:22819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201582.629810:0:22819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629874:0:23959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cdf83254c00/0xf9b71aee44721ea0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201582.629888:0:23959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201582.629929:0:23959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:3644:x1875064681380608:12345-0@lo:103:ldlm_bl.0 Request processed in 405us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.629937:0:23959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201582.631023:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681380608:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788201582.631727:0:24307:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788201582.635051:0:24307:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788201582.635060:0:24307:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788201582.635093:0:24307:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201582.635141:0:24307:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201582.635163:0:24307:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788201582.635192:0:24307:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788201582.636207:0:24307:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201582.636488:0:24307:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788201582.709883:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201582.709907:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681380864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201582.709973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201582.710028:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380864 00000100:00100000:2.0:1788201582.710036:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380864 00000100:00100000:2.0:1788201582.710089:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201582.710094:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681380736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201582.710102:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681380864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201582.710134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1788201582.710138:0:22809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788201582.710481:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380736 00000100:00100000:0.0:1788201582.710486:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380736 00000100:00100000:0.0:1788201582.710506:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201582.710512:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681380736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201582.710530:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788201582.710571:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681380736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.710577:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201582.710633:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681380736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201582.710790:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681380864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 692us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201582.710797:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201582.710887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681380864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788201582.902286:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201583.605204:0:24390:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201583.605979:0:24390:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201583.930787:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788201584.185761:0:22800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201584.185770:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0aafde000 from 13 10000000:01000000:3.0:1788201584.185777:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201584.185840:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201584.185853:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201584.185867:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201584.185899:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681380992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201584.185990:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201584.186050:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201584.187446:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681380992 00000100:00100000:2.0:1788201584.187462:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681380992 00000100:00100000:2.0:1788201584.187534:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201584.187546:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+19:22800:x1875064681380992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201584.187586:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201584.187613:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721ea7 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.187647:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 20 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.187661:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 20 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.187672:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03afa00, rc 0) 00000100:00100000:2.0:1788201584.187788:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:22800:x1875064681380992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.187808:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201584.187919:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681380992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201584.187940:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.187950:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201584.188033:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681381120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201584.188079:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201584.188105:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201584.188138:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681381120 00000100:00100000:2.0:1788201584.188142:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681381120 00000100:00100000:2.0:1788201584.188168:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201584.188174:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:22800:x1875064681381120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201584.188198:0:22797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201584.188218:0:22797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201584.188221:0:22797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788201584.188299:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:22800:x1875064681381120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.188307:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201584.188350:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681381120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201584.188418:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201584.188426:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.188435:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201584.188446:0:22800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201584.188449:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b62a4800 from 13 10000000:01000000:2.0:1788201584.188453:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201584.188475:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.188483:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.188492:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201584.188505:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681381248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201584.188531:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201584.188551:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089501240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201584.188589:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681381248 00000100:00100000:2.0:1788201584.188593:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681381248 00000100:00100000:2.0:1788201584.188616:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201584.188623:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:22800:x1875064681381248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201584.188631:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201584.188643:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721eb5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.188658:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.188668:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.188675:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03aea00, rc 0) 00000100:00100000:2.0:1788201584.188703:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681381248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.188708:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788201584.196950:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681381248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201584.196991:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201584.197904:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201584.198020:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681381376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201584.198110:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201584.198173:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201584.203935:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681381376 00000100:00100000:2.0:1788201584.203954:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681381376 00000100:00100000:2.0:1788201584.204045:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201584.204056:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681381376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201584.204090:0:22798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201584.204110:0:22798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201584.204113:0:22798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788201584.204283:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681381376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 229us (6171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.204291:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201584.204365:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681381376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201584.204494:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201584.204506:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201584.204519:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201584.956172:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.976099:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201586.998814:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201587.829907:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681381504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201587.830005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201587.830096:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681381504 00000100:00100000:1.0:1788201587.830104:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681381504 00000100:00100000:1.0:1788201587.830148:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201587.830157:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681381504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201587.830300:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788201587.830346:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681381504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201587.830353:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201587.830375:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681381632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201587.830393:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681381504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201587.830404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201587.830444:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681381632 00000100:00100000:0.0:1788201587.830448:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681381632 00000100:00100000:0.0:1788201587.830480:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201587.830491:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681381632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201587.830508:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788201587.830550:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681381632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201587.830556:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201587.830584:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681381632:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788201587.831840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201587.831845:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201587.831848:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201587.831851:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201587.831868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201587.831879:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201587.831882:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201587.831885:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201587.831933:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681381760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.832066:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681381888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.832326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201587.832369:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201587.832376:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681382016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.832399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201587.832435:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681381888 00000100:00100000:1.0:1788201587.832440:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681381888 00000100:00100000:1.0:1788201587.832475:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382016 00000100:00100000:1.0:1788201587.832478:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382016 00000100:00100000:1.0:1788201587.832496:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201587.832504:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681381888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.832548:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681381888:12345-0@lo:400:kworker.0 Request processed in 45us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201587.832555:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201587.832569:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201587.832575:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681382016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.832600:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681382016:12345-0@lo:400:kworker.0 Request processed in 26us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201587.832606:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788201587.832640:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6aa680 x1875064681382016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201587.832653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681382016:0@lo:400:kworker.0 00010000:00080000:1.0:1788201587.832664:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6a8000 x1875064681381888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201587.832671:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681381888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201587.832857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201587.832891:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681382272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201587.832920:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201587.832936:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201587.832942:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681382144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201587.832962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201587.832998:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681381760 00000100:00100000:3.0:1788201587.833003:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681381760 00000100:00100000:3.0:1788201587.833038:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201587.833044:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382272 00000100:00100000:3.0:1788201587.833046:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3645:x1875064681381760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.833050:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382272 00000100:00100000:1.0:1788201587.833090:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382144 00000100:00100000:3.0:1788201587.833096:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3645:x1875064681381760:12345-0@lo:400:kworker.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201587.833102:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201587.833111:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382144 00000100:00100000:1.0:1788201587.833143:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201587.833151:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681382272:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201587.833170:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201587.833176:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201587.833203:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681381760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.833204:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875064681382272:12345-0@lo:400:kworker.0 Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201587.833216:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788201587.833222:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6aa300 x1875064681382272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201587.833231:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201587.833236:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875064681382272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.833242:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681382144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201587.836332:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681382144:12345-0@lo:400:kworker.0 Request processed in 3084us (3359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201587.836346:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788201587.836777:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6a8e00 x1875064681382144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201587.836804:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681382144:0@lo:400:kworker.0 00010000:00010000:1.0:1788201588.023284:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201589.051050:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201589.384810:0:24681:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1788201589.692086:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201590.070366:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201590.418766:0:24734:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201590.420800:0:24734:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201591.095872:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201591.286023:0:24784:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201591.286388:0:24784:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201592.119399:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788201592.825864:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201592.887699:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201577/real 1788201577] req@ffff9ce0bf6abb80 x1875064681376896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201592.887732:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf6abb80 x1875064681376896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201592.887757:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201577/real 1788201577] req@ffff9ce0bf6a9f80 x1875064681376640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201592.887770:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0bf6a9f80 x1875064681376640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201592.887788:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201592.887796:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201592.887800:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681376896:0@lo:8:kworker.0 00000100:00080000:3.0:1788201592.887805:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201592.887809:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201592.887812:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681376640:0@lo:8:kworker.0 00000100:00080000:0.0:1788201592.888381:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201592.888386:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201592.888388:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201592.888391:0:493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201592.888416:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201592.888420:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201592.888422:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201592.888427:0:493:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:0.0:1788201592.888445:0:493:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201592.888453:0:493:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce0b94fb800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201592.888474:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf694380 x1875064681382912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201592.888489:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788201592.888492:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788201592.888494:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201592.888497:0:493:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:0.0:1788201592.888499:0:493:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201592.888502:0:493:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce087eb6000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1788201592.888515:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf694e00 x1875064681383040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201592.888557:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681382528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.888619:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.888664:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681383296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.888691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.888711:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201592.888717:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681382400:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.888770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.888793:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681383168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.888812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.888836:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681382656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.888855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.888870:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681383424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.888897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.888914:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201592.888919:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681382784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.888951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.888981:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382528 00000100:00100000:0.0:1788201592.888988:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382528 00000100:00100000:0.0:1788201592.889024:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382784 00000100:00100000:0.0:1788201592.889027:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382784 00000100:00100000:0.0:1788201592.889042:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201592.889050:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681382528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889101:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681382528:12345-0@lo:400:kworker.0 Request processed in 50us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.889108:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201592.889123:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201592.889130:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681382784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889161:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681382784:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.889166:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201592.889183:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383296 00000100:00100000:0.0:1788201592.889187:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383296 00000100:00100000:0.0:1788201592.889214:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383168 00000100:00100000:0.0:1788201592.889217:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383168 00000100:00100000:0.0:1788201592.889227:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382656 00000100:00100000:0.0:1788201592.889229:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382656 00000100:00100000:0.0:1788201592.889239:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383424 00000100:00100000:0.0:1788201592.889242:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383424 00000100:00100000:0.0:1788201592.889256:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201592.889262:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681383296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889300:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681383296:12345-0@lo:400:kworker.0 Request processed in 38us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.889307:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201592.889319:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201592.889325:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681383168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889350:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875064681383168:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.889355:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201592.889365:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201592.889371:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681382656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889395:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681382656:12345-0@lo:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.889400:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201592.889410:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201592.889416:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681383424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889441:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681383424:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.889446:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201592.889465:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382400 00000100:00100000:0.0:1788201592.889469:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382400 00000100:00100000:0.0:1788201592.889493:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788201592.889500:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3647:x1875064681382400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889529:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3647:x1875064681382400:12345-0@lo:400:kworker.0 Request processed in 30us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.889534:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788201592.889580:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201592.889585:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201592.889613:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681382784:0@lo:400:kworker.0 00010000:00080000:0.0:1788201592.889625:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf694700 x1875064681382656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201592.889634:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681382656:0@lo:400:kworker.0 00010000:00080000:0.0:1788201592.889644:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0ba3b3b80 x1875064681383424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201592.889651:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681383424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201592.889679:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681382912:0@lo:8:kworker.0 00000100:00100000:0.0:1788201592.889703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.889730:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681383040:0@lo:8:kworker.0 00000100:00100000:0.0:1788201592.889770:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.889806:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681382912 00000100:00100000:0.0:1788201592.889810:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681382912 00000100:00100000:0.0:1788201592.889825:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383040 00000100:00100000:0.0:1788201592.889828:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383040 00000100:00100000:0.0:1788201592.889838:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201592.889843:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681382912:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788201592.889868:0:24313:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:0.0:1788201592.889894:0:24313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee44721ec3 00002000:00100000:0.0:1788201592.889907:0:24313:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9cdf8364d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788201592.889912:0:24313:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788201592.889915:0:24313:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201592.890096:0:24313:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788201592.890125:0:24313:0:(import.c:65:import_set_state_nolock()) ffff9cdf83649800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201592.890162:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681382912:12345-0@lo:8:kworker.0 Request processed in 318us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.890168:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201592.890180:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201592.890184:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681383040:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201592.890195:0:24313:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788201592.891277:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf694380 x1875064681382912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201592.891288:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201592.891295:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788201592.891303:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201592.891308:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201592.891310:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0b94fb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201592.891323:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201592.891329:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681382912:0@lo:8:kworker.0 00000004:00080000:2.0:1788201592.891356:0:23545:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201592.891429:0:23545:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673188689921ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201592.891436:0:23545:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788201592.891606:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681382400:0@lo:400:kworker.0 00010000:00080000:2.0:1788201592.891622:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf695180 x1875064681383168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201592.891642:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875064681383168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201592.891655:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681382528:0@lo:400:kworker.0 00010000:00080000:2.0:1788201592.891668:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf695f80 x1875064681383296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201592.891676:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681383296:0@lo:400:kworker.0 00000004:00080000:2.0:1788201592.891767:0:23546:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788201592.891789:0:23546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23546:1875064681383680:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788201592.891833:0:23546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.891854:0:23546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090eb9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201592.891871:0:24314:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201592.891877:0:24314:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788201592.892013:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383680 00000100:00100000:2.0:1788201592.892018:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383680 00000100:00100000:2.0:1788201592.892128:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201592.892137:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23546:x1875064681383680:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788201592.892302:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201592.892312:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681383552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201592.892342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201592.892376:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201592.892699:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383552 00000100:00100000:3.0:1788201592.892704:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383552 00000100:00100000:3.0:1788201592.892762:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201592.892769:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875064681383552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201592.892788:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788201592.892828:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875064681383552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.892841:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788201592.892871:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf836c8700 x1875064681383552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201592.892886:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681383552:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1788201592.894679:0:24846:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788201592.894687:0:24846:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788201592.894791:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23546:x1875064681383680:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2652us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.894800:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788201592.894989:0:23546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf836ca300 x1875064681383680/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201592.895003:0:23546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23546:1875064681383680:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788201592.895014:0:23546:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788201592.895050:0:23546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23546:1875064681383808:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788201592.895083:0:23546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.895109:0:23546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201592.895180:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383808 00000100:00100000:2.0:1788201592.895194:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383808 00000100:00100000:2.0:1788201592.895239:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201592.895247:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23546:x1875064681383808:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788201592.895272:0:24314:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788201592.895307:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23546:x1875064681383808:12345-0@lo:5:osp-pre-0-1.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.895313:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788201592.895411:0:23546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6a9f80 x1875064681383808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201592.895421:0:23546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23546:1875064681383808:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788201592.895429:0:23546:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788201592.895455:0:23546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23546:1875064681383936:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788201592.895478:0:23546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.895492:0:23546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a07abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201592.895502:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681383936 00000100:00100000:2.0:1788201592.895506:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681383936 00000100:00100000:2.0:1788201592.895530:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201592.895535:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23546:x1875064681383936:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788201592.895558:0:24314:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:2.0:1788201592.900019:0:23536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:3.0:1788201592.953927:0:24308:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788201592.953948:0:24308:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788201592.954052:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681384064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201592.954122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201592.958292:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681383040:12345-0@lo:8:kworker.0 Request processed in 68099us (68514us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201592.958311:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788201592.958363:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201592.958368:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201592.958372:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681383040:0@lo:8:kworker.0 00000100:00100000:1.0:1788201592.958450:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201592.958464:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681384192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201592.958500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201592.958547:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384064 00000100:00100000:1.0:1788201592.958553:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384064 00000100:00100000:1.0:1788201592.958596:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384192 00000100:00100000:1.0:1788201592.958600:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384192 00000100:00100000:1.0:1788201592.958614:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201592.958621:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681384064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201592.958652:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788201592.958693:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681384064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (4569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.958699:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201592.958712:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201592.958718:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681384192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201592.958733:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788201592.958786:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681384192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.958791:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201592.958823:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681384192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201592.958838:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681384064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201592.958979:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23546:x1875064681383936:12345-0@lo:5:osp-pre-0-1.0 Request processed in 63443us (63499us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788201592.958987:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788201592.959020:0:23546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf836cb100 x1875064681383936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201592.959030:0:23546:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788201592.959035:0:23546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23546:1875064681383936:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788201592.959047:0:23546:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788201592.959082:0:23546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23546:1875064681384320:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788201592.959117:0:23546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201592.959137:0:23546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0862f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.959157:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384320 00000100:00100000:1.0:1788201592.959160:0:22814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384320 00000100:00100000:1.0:1788201592.959184:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201592.959189:0:22814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23546:x1875064681384320:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788201592.959221:0:22814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23546:x1875064681384320:12345-0@lo:900:osp-pre-0-1.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.959226:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788201592.959250:0:23546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf680000 x1875064681384320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201592.959258:0:23546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23546:1875064681384320:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788201593.146399:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.166940:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.191874:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.964688:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201575/real 1788201575] req@ffff9ce0b6c89180 x1875064681374592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201595 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201595.964733:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0b6c89180 x1875064681374592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201595 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201595.964769:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201575/real 1788201575] req@ffff9ce0b6c89c00 x1875064681374720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201595 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201595.964781:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce0b6c89c00 x1875064681374720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201595 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201595.964799:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5be9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201595.964817:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201595.964822:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681374592:0@lo:8:kworker.0 00000100:00080000:2.0:1788201595.964827:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201595.964832:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201595.964835:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681374720:0@lo:8:kworker.0 00000100:00100000:3.0:1788201595.965735:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681384448:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.965835:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.965899:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384448 00000100:00100000:3.0:1788201595.965906:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384448 00000100:00100000:3.0:1788201595.965963:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201595.965972:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3644:x1875064681384448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966020:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3644:x1875064681384448:12345-0@lo:400:kworker.0 Request processed in 50us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.966027:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201595.966070:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681384448:0@lo:400:kworker.0 00000100:00080000:3.0:1788201595.966101:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201595.966114:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201595.966117:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5be9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201595.966121:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:3.0:1788201595.966125:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201595.966129:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce0a5be9000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201595.966138:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681384576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.966200:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384576 00000100:00100000:3.0:1788201595.966204:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384576 00000100:00100000:3.0:1788201595.966230:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201595.966236:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681384576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966272:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681384576:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.966278:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201595.966307:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681384576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966342:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8e00 x1875064681384704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201595.966357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201595.966360:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201595.966362:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201595.966365:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:3.0:1788201595.966368:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201595.966372:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce0a1aa3800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201595.966383:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6a8380 x1875064681384832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201595.966427:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681384960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.966485:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384960 00000100:00100000:3.0:1788201595.966489:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384960 00000100:00100000:3.0:1788201595.966514:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201595.966520:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681384960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966554:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681384960:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.966560:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788201595.966587:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6ab800 x1875064681384960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201595.966597:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681384960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966628:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681385088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201595.966696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201595.966699:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201595.966702:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201595.966705:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 673 00000100:00080000:3.0:1788201595.966708:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201595.966712:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce087eb6000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1788201595.966719:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681385216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.966797:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf8410f480 x1875064681385344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201595.966831:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681385472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.966882:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385472 00000100:00100000:3.0:1788201595.966886:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385472 00000100:00100000:3.0:1788201595.966911:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201595.966930:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681385472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.966966:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681385472:12345-0@lo:400:kworker.0 Request processed in 50us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.966972:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788201595.966998:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8410f800 x1875064681385472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201595.967007:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681385472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.967039:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681385600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.967061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.967085:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385600 00000100:00100000:3.0:1788201595.967089:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385600 00000100:00100000:3.0:1788201595.967117:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201595.967123:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681385600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.967154:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681385600:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.967159:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788201595.967175:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201595.967192:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8410f800 x1875064681385600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201595.967201:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681385600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.967239:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681385728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.967260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.967281:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385728 00000100:00100000:3.0:1788201595.967285:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385728 00000100:00100000:3.0:1788201595.967308:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201595.967315:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681385728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.967349:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681385728:12345-0@lo:400:kworker.0 Request processed in 35us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.967354:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788201595.967369:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788201595.967383:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf8410f800 x1875064681385728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201595.967393:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681385728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.968658:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385216 00000100:00100000:2.0:1788201595.968667:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385216 00000100:00100000:2.0:1788201595.968722:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201595.968730:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681385216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.968817:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681385216:12345-0@lo:400:kworker.0 Request processed in 88us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.968824:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201595.968849:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681384704:0@lo:8:kworker.0 00000100:00100000:2.0:1788201595.968885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201595.968930:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681384832:0@lo:8:kworker.0 00000100:00100000:2.0:1788201595.968956:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201595.968985:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681385344:0@lo:8:kworker.0 00000100:00100000:2.0:1788201595.969023:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201595.969050:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384704 00000100:00100000:2.0:1788201595.969055:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384704 00000100:00100000:2.0:1788201595.969067:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681384832 00000100:00100000:2.0:1788201595.969069:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681384832 00000100:00100000:2.0:1788201595.969091:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385344 00000100:00100000:2.0:1788201595.969094:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385344 00000100:00100000:2.0:1788201595.969104:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201595.969108:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681384704:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788201595.969134:0:24313:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:2.0:1788201595.969160:0:24313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44721eca 00002000:00100000:2.0:1788201595.969172:0:24313:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ce0ab9c1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788201595.969176:0:24313:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788201595.969179:0:24313:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201595.969248:0:24313:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201595.969271:0:24313:0:(import.c:65:import_set_state_nolock()) ffff9ce0ab9c7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201595.969308:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681384704:12345-0@lo:8:kworker.0 Request processed in 198us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.969314:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201595.969326:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201595.969329:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681384832:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201595.969340:0:24313:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201595.969361:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681384832:12345-0@lo:8:kworker.0 Request processed in 30us (404us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201595.969367:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201595.969376:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201595.969386:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681385344:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201595.969396:0:24313:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201595.969417:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681385344:12345-0@lo:8:kworker.0 Request processed in 31us (395us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201595.969423:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788201595.969459:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6a8e00 x1875064681384704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201595.969468:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201595.969475:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788201595.969482:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201595.969487:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201595.969489:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a5be9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201595.969504:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201595.969508:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681384704:0@lo:8:kworker.0 00000100:00080000:2.0:1788201595.969519:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201595.969523:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201595.969525:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681384832:0@lo:8:kworker.0 00000100:00080000:2.0:1788201595.969532:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201595.969535:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201595.969537:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681385344:0@lo:8:kworker.0 00000004:00080000:2.0:1788201595.969581:0:22828:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788201595.969597:0:22828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22828:1875064681385984:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788201595.969621:0:22828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201595.969635:0:22828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce090064840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.969651:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385984 00000100:00100000:2.0:1788201595.969655:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385984 00000100:00100000:2.0:1788201595.969679:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201595.969685:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22828:x1875064681385984:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788201595.972771:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201595.972786:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201595.972807:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681385856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201595.972874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201595.973000:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385088 00000100:00100000:1.0:1788201595.973009:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385088 00000100:00100000:1.0:1788201595.973052:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201595.973061:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681385088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201595.973120:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681385088:12345-0@lo:400:kworker.0 Request processed in 60us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.973126:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00080000:1.0:1788201595.973158:0:22827:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201595.973239:0:22827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676270499847ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201595.973245:0:22827:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788201595.973410:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681385856 00000100:00100000:1.0:1788201595.973414:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681385856 00000100:00100000:1.0:1788201595.973441:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201595.973456:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681385856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201595.973478:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201595.973508:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875064681385856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.973513:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201595.976211:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681385088:0@lo:400:kworker.0 00010000:00080000:3.0:1788201595.976262:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf836ca300 x1875064681385856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201595.976280:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681385856:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788201595.976544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6aa680 x1875064681385216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201595.976555:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681385216:0@lo:400:kworker.0 00000004:00080000:2.0:1788201595.983766:0:22783:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788201595.991302:0:24313:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788201595.991316:0:24313:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788201595.991323:0:24313:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:1.0:1788201596.016568:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201596.016580:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.016596:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788201596.016601:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201596.016607:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.016634:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.016644:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.016652:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.016688:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201596.016983:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.016991:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.017000:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.017005:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.017015:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.017034:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.017041:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6496588/0xf9b71aee44721ed1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.017083:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.017086:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.017088:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.019780:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.019793:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.019820:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.019824:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.019830:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.019844:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.019855:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.019862:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.019884:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.020364:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.020372:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.020382:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.020387:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.020396:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.020411:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.020418:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721ed8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.020437:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.020439:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.020440:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.021454:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.021464:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.021476:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.021479:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.021484:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.021497:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.021520:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.021527:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.021584:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201596.029044:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.029058:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.029074:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.029079:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.029085:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.029102:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.029112:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.029120:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029544:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201596.029553:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029563:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.029568:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029578:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029593:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029601:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721edf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029627:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.029632:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029638:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.029649:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029657:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029668:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.029677:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.029679:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.029681:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.037095:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201596.037111:0:24313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721ee6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.037405:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201596.038410:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.038419:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.038433:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.038438:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.038443:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.038456:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.038465:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.038471:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.038504:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.038729:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.038965:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.038986:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.038991:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.039000:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.039016:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.039023:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000270d242b/0xf9b71aee44721eed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.039038:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.039040:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.039042:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201596.040557:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.040567:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.040581:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.040586:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.040590:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.040603:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.040624:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.040632:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.040656:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201596.040946:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201596.040959:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.040967:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201596.040971:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.040979:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.040993:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.041001:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721ef4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.041017:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.041018:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.041020:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201596.044060:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.044084:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.044100:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.044112:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.044118:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.044132:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.044142:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.044150:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.044178:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201596.045828:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.045839:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.045853:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.045857:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.045862:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.045875:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.045883:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.045897:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.045926:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201596.046164:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201596.046172:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046181:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.046185:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046194:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046216:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046223:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c9bd5f/0xf9b71aee44721efb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046239:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.046242:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046248:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83296200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.046250:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046257:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046265:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046272:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d5e08a9/0xf9b71aee44721f02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046281:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.046283:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.046289:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201596.046510:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.046515:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.046524:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.046527:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.046532:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.046542:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.046550:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.046557:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.046575:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.046692:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.046697:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046704:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83296400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.046707:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046724:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046735:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046758:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcc5bc07/0xf9b71aee44721f09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.046772:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.046773:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.046775:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.046977:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201596.047339:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.047346:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047364:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.047367:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.047371:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047381:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047390:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047397:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047448:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201596.047843:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.047849:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047858:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.047862:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.047866:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047875:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047894:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.047901:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.049712:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201596.049723:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.049735:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83296800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.049752:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.049774:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.049793:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.049801:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b09e60db/0xf9b71aee44721f10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.050034:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201596.050040:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.050048:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83296a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201596.050051:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.050059:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.050151:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.050161:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.050163:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.050165:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.050722:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.050822:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201596.050830:0:24313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dc4f4a3/0xf9b71aee44721f17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201596.051881:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.051891:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.051905:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.051910:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.051928:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.051942:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.051951:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.051969:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.053205:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201596.054007:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201596.054015:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.054032:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788201596.054037:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201596.054042:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.054053:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.054062:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.054083:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055328:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201596.055338:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055349:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201596.055354:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055376:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055394:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055401:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001674be3/0xf9b71aee44721f1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055418:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201596.055421:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055427:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83296600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201596.055429:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055436:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055444:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.055451:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.055452:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.055459:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.058372:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201596.058384:0:24313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025371518/0xf9b71aee44721f25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.060386:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.065807:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.065820:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.065837:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.065843:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.065849:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.065863:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.065874:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.065882:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.065905:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201596.067843:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.067856:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.067869:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.067874:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.067883:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.067904:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.067912:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.067943:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.067945:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.067946:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.068125:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.068133:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.068145:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.068149:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.068155:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.068180:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.068189:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.068196:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.068222:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201596.068587:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.068594:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.068603:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.068613:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.068623:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.068636:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.068643:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.068656:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.068658:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.068659:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.070664:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.070676:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.070691:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.070695:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.070701:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.070727:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.070759:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.070781:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.070802:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201596.071008:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.071015:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.071024:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.071028:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.071037:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.071053:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.071066:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.071094:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.071096:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.071098:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.076208:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.076220:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.076236:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.076241:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.076247:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.076260:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.076269:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.076276:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.076301:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201596.076860:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.076868:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.076878:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.076882:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.076892:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.076909:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.076928:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e6cd51/0xf9b71aee44721f41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.076948:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.076950:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.076951:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.077063:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.077070:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.077089:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.077093:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.077097:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.077118:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.077126:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.077132:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.077886:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201596.078474:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.078482:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.078495:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.078499:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.078504:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.078514:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.078521:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.078538:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078596:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201596.078602:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078610:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.078613:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078621:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078635:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078642:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234ad367/0xf9b71aee44721f48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078657:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.078661:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078666:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.078670:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078677:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078700:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.078708:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.078709:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.078711:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.082290:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201596.082304:0:24313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c4ee2e/0xf9b71aee44721f4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201596.083476:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.083487:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083502:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.083507:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.083513:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083527:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083537:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083545:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083576:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201596.083588:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201596.083593:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083601:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201596.083606:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083615:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083631:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083639:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099c1d427/0xf9b71aee44721f56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.083653:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.083655:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.083656:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.084025:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.084031:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084042:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.084051:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.084056:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084065:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084072:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084080:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084094:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201596.084102:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201596.084105:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084111:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201596.084114:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084121:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084131:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084149:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084164:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.084166:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201596.084167:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.084303:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.084547:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.084553:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084562:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.084565:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.084570:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084579:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084586:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084593:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.084612:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201596.085033:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.085044:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.085055:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.085057:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.085060:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.085068:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.085253:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.085261:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.085279:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201596.085392:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201596.085398:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085406:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201596.085409:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085417:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085429:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085436:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046cc19ec/0xf9b71aee44721f64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085450:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201596.085454:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085469:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201596.085472:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085479:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085488:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085495:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000194bfa74/0xf9b71aee44721f6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.085507:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.085509:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.085510:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.085671:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.088636:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.088650:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.088677:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.088682:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.088689:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.088704:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.088721:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.088729:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.088773:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.091003:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.091016:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.091029:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.091034:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.091044:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.091064:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.091727:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b986041e/0xf9b71aee44721f72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.091771:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.091774:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.091776:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201596.094554:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201596.094568:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.094584:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1788201596.094588:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201596.094593:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.094606:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.094615:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.094622:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.094659:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201596.094771:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.094779:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.094787:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.094792:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.094800:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.094818:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.094825:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3a300b4/0xf9b71aee44721f79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.094840:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.094842:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.094849:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.097523:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.097535:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.097550:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.097555:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.097561:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.097574:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.097589:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.097596:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.097648:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.097982:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.097991:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.098001:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.098006:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.098015:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.098031:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.098038:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b03efaf/0xf9b71aee44721f80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.098054:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.098056:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.098057:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.098236:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.098243:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.098252:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.098255:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.098260:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.098269:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.098276:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.098283:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.098313:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201596.098475:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201596.098482:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.098489:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aee00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201596.098492:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.098500:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.098511:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.098518:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a857339/0xf9b71aee44721f87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.098532:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.098533:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201596.098535:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.098708:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.099688:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.099701:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.099705:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.099720:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.099731:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.099757:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.099766:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.099785:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.100008:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.100014:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.100023:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.100026:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.100035:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.100051:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.100058:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e65312/0xf9b71aee44721f8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.100075:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.100077:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.100079:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.100205:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.100211:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100219:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.100228:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.100232:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100242:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100250:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100257:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100272:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201596.100281:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201596.100285:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100291:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201596.100294:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100302:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100312:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100330:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e873bdf/0xf9b71aee44721f95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100343:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.100345:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.100347:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.100787:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.100794:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100803:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.100806:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.100809:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100818:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100824:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100832:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.100851:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.101001:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.101006:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101014:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.101017:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101039:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101051:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101058:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000629faece/0xf9b71aee44721f9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101073:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.101075:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.101077:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.101131:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.101142:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101151:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.101154:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.101158:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101167:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101174:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101181:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101194:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201596.101201:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201596.101205:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101211:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201596.101214:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101222:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101239:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101245:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000103d58bf/0xf9b71aee44721fa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101255:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.101257:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201596.101258:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201596.101582:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201596.101588:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101597:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788201596.101600:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201596.101603:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101612:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101618:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101626:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.101655:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201596.101859:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201596.101864:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101872:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201596.101875:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101883:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101894:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201596.101911:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d98aab7/0xf9b71aee44721faa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788201596.102018:0:24313:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788201596.102107:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22828:x1875064681385984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 132419us (132482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.102117:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201596.102263:0:22828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22828:1875064681385984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201596.102279:0:22828:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788201596.102322:0:22828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22828:1875064681386112:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201596.102358:0:22828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201596.102386:0:22828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf82476000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201596.102425:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681386112 00010000:00010000:1.0:1788201596.102427:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.102429:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201596.102430:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201596.102431:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681386112 00000100:00100000:2.0:1788201596.102499:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201596.102508:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22828:x1875064681386112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788201596.102540:0:24846:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1788201596.105863:0:24308:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788201596.105907:0:24308:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788201596.107262:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22828:x1875064681386112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4747us (4896us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788201596.107281:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201596.113900:0:22828:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788201596.113923:0:22828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22828:1875064681386112:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788201596.113940:0:22828:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1788201596.213835:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201597.238464:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201598.015081:0:25131:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201598.015085:0:25131:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788201598.015087:0:25131:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788201598.015193:0:25131:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ce0ab9c2000 00000020:01000004:2.0:1788201598.015210:0:25131:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788201598.015226:0:25131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788201598.015250:0:25131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cdf830b3380) 00000020:00000080:2.0:1788201598.015269:0:25131:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788201598.066125:0:25131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000100:00100000:0.0:1788201598.069959:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201598.070295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681386368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201598.070366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.070782:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681386368 00000100:00100000:1.0:1788201598.070791:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681386368 00000100:00100000:1.0:1788201598.070835:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201598.070844:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681386368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201598.070877:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788201598.070935:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681386368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201598.070943:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201598.073176:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681386368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201598.074085:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681386240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201598.074148:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1788201598.074461:0:25131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:1.0:1788201598.074659:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681386240 00000100:00100000:1.0:1788201598.074666:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681386240 00000100:00100000:1.0:1788201598.074730:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201598.074761:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681386240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201598.074790:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201598.074836:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681386240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201598.074843:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201598.074987:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681386240:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201598.075260:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00100000:10000000:1.0:1788201598.075564:0:25131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788201598.075776:0:25131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788201598.076160:0:25131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788201598.076440:0:25131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788201598.076650:0:25131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1788201598.077574:0:25131:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201598.078004:0:25131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788201598.078027:0:25131:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201598.078041:0:25131:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf9b71aee44721fb8 00000020:01000004:1.0:1788201598.078047:0:25131:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788201598.078069:0:25131:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788201598.078072:0:25131:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788201598.078077:0:25131:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788201598.078104:0:25131:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788201598.078109:0:25131:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:0.0:1788201598.078672:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681386496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201598.078783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.078941:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681386496 00000100:00100000:2.0:1788201598.078949:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681386496 00000100:00100000:2.0:1788201598.079012:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201598.079022:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681386496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201598.079056:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788201598.079101:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681386496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.079108:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201598.079379:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681386496:0@lo:41:osp-pre-0-1.0 00000040:01000000:2.0:1788201598.099861:0:25131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201598.099934:0:25131:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788201598.099939:0:25131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201598.099941:0:25131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201598.099942:0:25131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201598.099944:0:25131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201598.099945:0:25131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201598.099946:0:25131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201598.099948:0:25131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201598.099950:0:25131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201598.099951:0:25131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201598.099955:0:25131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788201598.099958:0:25131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201598.099959:0:25131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201598.099960:0:25131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201598.099961:0:25131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201598.099962:0:25131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201598.099963:0:25131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201598.099964:0:25131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201598.099965:0:25131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201598.099966:0:25131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201598.100000:0:25131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788201598.100021:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681386624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201598.100105:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.100140:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0942119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.100217:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681386624 00000100:00100000:0.0:1788201598.100226:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681386624 00000100:00100000:0.0:1788201598.100286:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201598.100295:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:25131:x1875064681386624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201598.100332:0:22797:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788201598.100335:0:22797:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788201598.100339:0:22797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788201598.104059:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:25131:x1875064681386624:12345-0@lo:253:mount.lustre.0 Request processed in 3757us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.104075:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201598.104544:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681386624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201598.104560:0:25131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788201598.104563:0:25131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201598.104565:0:25131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201598.104566:0:25131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201598.104567:0:25131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201598.104567:0:25131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201598.104568:0:25131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201598.104569:0:25131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201598.104571:0:25131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201598.104571:0:25131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201598.104590:0:25131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce0ab9c2000 from lustre-OST0001 10000000:01000000:2.0:1788201598.104617:0:25131:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788201598.104619:0:25131:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788201598.104628:0:25131:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce0a6580000 local copy 00010000:00010000:2.0:1788201598.104639:0:25131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201598.104762:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681386752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201598.104797:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.104828:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.104835:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681386752 00000100:00100000:0.0:1788201598.104841:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681386752 00000100:00100000:0.0:1788201598.104884:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201598.104892:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:25131:x1875064681386752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201598.105426:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:25131:x1875064681386752:12345-0@lo:501:mount.lustre.0 Request processed in 533us (626us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201598.105434:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201598.105496:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681386752:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788201598.105511:0:25131:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201598.105531:0:25131:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788201598.105537:0:25131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.105546:0:25131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255200/0xf9b71aee44721beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721bf2 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201598.105583:0:25131:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce0ab9c2000 10000000:01000000:2.0:1788201598.105588:0:25131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201598.105593:0:25131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788201598.105595:0:25131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201598.105598:0:25131:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788201598.105601:0:25131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201598.105622:0:25131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af400/0xf9b71aee44721fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.105631:0:25131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af400/0xf9b71aee44721fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.105712:0:25131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af400/0xf9b71aee44721fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201598.105730:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681386880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201598.105836:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.105865:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.106130:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681386880 00000100:00100000:3.0:1788201598.106135:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681386880 00000100:00100000:3.0:1788201598.106175:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788201598.106184:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:25131:x1875064681386880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201598.106193:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201598.106207:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74c00/0xf9b71aee44721fc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721fbf expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.106231:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74c00/0xf9b71aee44721fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721fbf expref: 22 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.106242:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74c00/0xf9b71aee44721fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721fbf expref: 22 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.106250:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74c00, rc 0) 00000100:00100000:3.0:1788201598.106291:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681386880:12345-0@lo:101:mount.lustre.0 Request processed in 108us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.106304:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201598.106431:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681386880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201598.106444:0:25131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af400/0xf9b71aee44721fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721fc6 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.106453:0:25131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af400/0xf9b71aee44721fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721fc6 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201598.108466:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788201598.112490:0:25131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201598.117814:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788201598.117889:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788201598.117919:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788201598.118455:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788201598.118476:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788201598.118487:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788201598.118499:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788201598.118511:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788201598.118543:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788201598.118571:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788201598.118577:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788201598.119084:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201598.119432:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201598.119489:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0a00ece40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.119926:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387008 00000100:00100000:3.0:1788201598.120159:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387008 00000100:00100000:3.0:1788201598.120218:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201598.120275:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201598.120507:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387008:12345-0@lo:501:mount.lustre.0 Request processed in 232us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.120515:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201598.123120:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201598.123204:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201598.123266:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.123300:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.123451:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387136 00000100:00100000:0.0:1788201598.123457:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387136 00000100:00100000:0.0:1788201598.123508:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201598.123517:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387136:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201598.130624:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387136:12345-0@lo:503:mount.lustre.0 Request processed in 7097us (7347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.130801:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201598.130954:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387136:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201598.131632:0:25131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201598.133035:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201598.133832:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.133884:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.133969:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387264 00000100:00100000:0.0:1788201598.133977:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387264 00000100:00100000:0.0:1788201598.134079:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201598.134090:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201598.135639:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387264:12345-0@lo:502:mount.lustre.0 Request processed in 1546us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.135650:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201598.135870:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201598.136128:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788201598.136159:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788201598.136173:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788201598.136204:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788201598.136220:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788201598.136245:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788201598.136260:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788201598.136272:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788201598.136284:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788201598.136317:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201598.136363:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.141633:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b25eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.141926:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387392 00000100:00100000:3.0:1788201598.141936:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387392 00000100:00100000:3.0:1788201598.141990:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201598.142000:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201598.142392:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387392:12345-0@lo:502:mount.lustre.0 Request processed in 392us (6027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.142400:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201598.145535:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201598.145657:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788201598.145673:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788201598.146995:0:25135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201598.147006:0:25135:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788201598.147020:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.147023:0:25135:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788201598.147029:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201598.147045:0:25135:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cdf821d19c0) 00000020:00000080:3.0:1788201598.147072:0:25135:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201598.147079:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201598.147214:0:25135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0ab9c2000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788201598.147225:0:25135:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201598.147242:0:25135:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf9b71aee44721fd4 00010000:00010000:3.0:1788201598.163068:0:25135:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788201598.163525:0:25135:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1788201598.165470:0:25135:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788201598.167214:0:25135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788201598.167226:0:25135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201598.167232:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.167234:0:25135:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788201598.167237:0:25135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201598.167241:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.167243:0:25135:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201598.167246:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201598.167247:0:25135:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201598.167250:0:25135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201598.167252:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.167253:0:25135:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201598.167255:0:25135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201598.167258:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.167259:0:25135:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201598.167262:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201598.167289:0:25135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201598.167291:0:25135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.167293:0:25135:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201598.167296:0:25135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788201598.168899:0:25131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788201598.168948:0:25131:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788201598.172233:0:25131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af400/0xf9b71aee44721fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721fc6 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.172252:0:25131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af400/0xf9b71aee44721fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721fc6 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201598.172261:0:25131:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0ab9c2000 from 1 10000000:01000000:1.0:1788201598.172264:0:25131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201598.172303:0:25131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.172312:0:25131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.172322:0:25131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201598.172347:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201598.172417:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.172459:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09258bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.175063:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387520 00000100:00100000:3.0:1788201598.175074:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387520 00000100:00100000:3.0:1788201598.175128:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201598.175139:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:25131:x1875064681387520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201598.175157:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201598.175174:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721fdb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.175199:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.175224:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.175232:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74e00, rc 0) 00000100:00100000:3.0:1788201598.175305:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681387520:12345-0@lo:101:mount.lustre.0 Request processed in 168us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.175313:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201598.176916:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201598.176943:0:25131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.176955:0:25131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201598.178218:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788201598.178493:0:25131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201598.178891:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788201598.178929:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788201598.178942:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788201598.178952:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788201598.178976:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788201598.178990:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788201598.179001:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788201598.179015:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788201598.179027:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788201598.179038:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788201598.179050:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788201598.179068:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788201598.179073:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788201598.179149:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201598.179211:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201598.179506:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387648 00000100:00100000:3.0:1788201598.179513:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387648 00000100:00100000:3.0:1788201598.179567:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201598.179577:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681387648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201598.179931:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681387648:12345-0@lo:501:mount.lustre.0 Request processed in 123us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.179939:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201598.180059:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089baab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201598.180082:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201598.180114:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201598.180165:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.180223:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce089baab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.180260:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387776 00000100:00100000:0.0:1788201598.180265:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387776 00000100:00100000:0.0:1788201598.180326:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201598.180334:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681387776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201598.180426:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681387776:12345-0@lo:503:mount.lustre.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.180433:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201598.180505:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201598.180936:0:25131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201598.180997:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201598.181038:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.181370:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.181445:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681387904 00000100:00100000:3.0:1788201598.181450:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681387904 00000100:00100000:3.0:1788201598.181479:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201598.181486:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681387904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201598.181609:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681387904:12345-0@lo:502:mount.lustre.0 Request processed in 122us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.181616:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201598.181872:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681387904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201598.182057:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788201598.182083:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788201598.182097:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788201598.182108:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788201598.182121:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788201598.182133:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788201598.182161:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788201598.182176:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788201598.182187:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788201598.182198:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788201598.182212:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788201598.182237:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201598.182278:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.182312:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.182361:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388032 00000100:00100000:3.0:1788201598.182366:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388032 00000100:00100000:3.0:1788201598.182401:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201598.182408:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681388032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201598.182492:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681388032:12345-0@lo:502:mount.lustre.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.182506:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201598.182603:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201598.182639:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788201598.182659:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788201598.183487:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201598.183496:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183499:0:25139:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201598.183505:0:25139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0ab9c2000 00000020:00000080:3.0:1788201598.183507:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201598.183514:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201598.183516:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183517:0:25139:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201598.183519:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201598.183521:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183522:0:25139:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201598.183526:0:25139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce0ab9c2000 00000020:00000080:3.0:1788201598.183528:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201598.183581:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201598.183585:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183586:0:25139:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788201598.183588:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201598.183590:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183591:0:25139:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788201598.183594:0:25139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0ab9c2000 00000020:00000080:3.0:1788201598.183596:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201598.183614:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201598.183617:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183618:0:25139:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788201598.183620:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201598.183622:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183623:0:25139:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788201598.183625:0:25139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce0ab9c2000 00000020:00000080:3.0:1788201598.183627:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201598.183657:0:25139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201598.183660:0:25139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201598.183666:0:25139:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788201598.183670:0:25139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788201598.186091:0:25131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788201598.186132:0:25131:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201598.186165:0:25131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.186178:0:25131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201598.186235:0:25131:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201598.186238:0:25131:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce0ab9c2000 10000000:01000000:1.0:1788201598.186241:0:25131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce0ab9c2000 10000000:01000000:1.0:1788201598.186246:0:25131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201598.186251:0:25131:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ce0ab9c2000 from 1 10000000:01000000:1.0:1788201598.186254:0:25131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201598.186289:0:25131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.186298:0:25131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.186308:0:25131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201598.186331:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201598.186391:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.186426:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.186481:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388160 00000100:00100000:3.0:1788201598.186488:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388160 00000100:00100000:3.0:1788201598.186539:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201598.186548:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:25131:x1875064681388160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201598.186562:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201598.186576:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721ff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44721fe9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.186598:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44721fe9 expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.186608:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a74400/0xf9b71aee44721ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721fe9 expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.186615:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74400, rc 0) 00000100:00100000:3.0:1788201598.186663:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388160:12345-0@lo:101:mount.lustre.0 Request processed in 116us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.186670:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201598.186885:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201598.186898:0:25131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ff0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.186919:0:25131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee44721ff0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201598.189920:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788201598.190197:0:25131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201598.190387:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788201598.190413:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788201598.190426:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788201598.190439:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788201598.190451:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788201598.190463:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788201598.190475:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788201598.190486:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788201598.190497:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788201598.190509:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788201598.190520:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788201598.190530:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788201598.190540:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788201598.190550:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788201598.190560:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788201598.190570:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788201598.190597:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788201598.190610:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788201598.190621:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788201598.190634:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788201598.190644:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788201598.190655:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788201598.190667:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788201598.190682:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788201598.190696:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788201598.190728:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788201598.190778:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788201598.190794:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788201598.190807:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788201598.190836:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788201598.190851:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788201598.190865:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788201598.190893:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788201598.190923:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788201598.190936:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788201598.190949:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788201598.190961:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788201598.190973:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788201598.190986:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788201598.191000:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788201598.191012:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788201598.191025:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788201598.191037:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788201598.191050:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788201598.191062:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788201598.191074:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788201598.191086:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788201598.191097:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788201598.191222:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788201598.191243:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788201598.191259:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788201598.191264:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788201598.191352:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201598.191418:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.191456:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.191549:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388288 00000100:00100000:3.0:1788201598.191556:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388288 00000100:00100000:3.0:1788201598.191606:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201598.191615:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201598.191734:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388288:12345-0@lo:501:mount.lustre.0 Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.191765:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201598.193091:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201598.193139:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201598.193198:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.197197:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.201479:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388416 00000100:00100000:0.0:1788201598.201494:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388416 00000100:00100000:0.0:1788201598.201615:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201598.201626:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201598.201961:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388416:12345-0@lo:503:mount.lustre.0 Request processed in 336us (8761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.201969:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201598.203299:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201598.203962:0:25131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201598.204045:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201598.204121:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.204166:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201598.204241:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388544 00000100:00100000:2.0:1788201598.204247:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388544 00000100:00100000:2.0:1788201598.204292:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201598.204306:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201598.204480:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388544:12345-0@lo:502:mount.lustre.0 Request processed in 177us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.204490:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201598.204620:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201598.207476:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788201598.207507:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788201598.207518:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788201598.207530:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788201598.207540:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788201598.207551:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788201598.207562:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788201598.207573:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788201598.207584:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788201598.207595:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788201598.207618:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788201598.207629:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788201598.208856:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788201598.208880:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788201598.208890:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788201598.208912:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788201598.208926:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788201598.208937:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788201598.208948:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788201598.208958:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788201598.208969:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788201598.208979:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788201598.208989:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788201598.209001:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788201598.209020:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788201598.209031:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788201598.209052:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788201598.209064:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788201598.209075:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788201598.209085:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788201598.209095:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788201598.209105:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788201598.209116:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788201598.209128:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788201598.209139:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788201598.209149:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788201598.209159:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788201598.209170:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788201598.209180:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788201598.209190:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788201598.209200:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788201598.209210:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788201598.209231:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788201598.209242:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788201598.209253:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788201598.209263:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788201598.209273:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788201598.209283:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788201598.209332:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201598.209399:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.209441:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.209585:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388672 00000100:00100000:0.0:1788201598.209592:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388672 00000100:00100000:0.0:1788201598.209625:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201598.209633:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201598.209875:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388672:12345-0@lo:502:mount.lustre.0 Request processed in 242us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.209882:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201598.211124:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201598.211334:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788201598.211360:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788201598.211392:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201598.211448:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.211487:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.211694:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388800 00000100:00100000:3.0:1788201598.212835:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388800 00000100:00100000:3.0:1788201598.212924:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788201598.212934:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201598.213074:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681388800:12345-0@lo:502:mount.lustre.0 Request processed in 141us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.213082:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201598.216012:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681388800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201598.216113:0:25131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788201598.216128:0:25131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788201598.217956:0:25144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788201598.217971:0:25144:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cdf820c3380) 00000020:00000080:1.0:1788201598.217997:0:25144:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788201598.218155:0:25144:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0ab9c2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201598.218159:0:25144:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0ab9c2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201598.218162:0:25144:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0ab9c2000 3 00010000:00080000:1.0:1788201598.218191:0:25144:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf822d6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201598.224216:0:25144:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788201598.224321:0:25144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788201598.224364:0:25144:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201598.224376:0:25144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf9b71aee44721ffe 00000100:00080000:1.0:1788201598.224385:0:25144:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201598.224391:0:25144:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cdf822d6000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201598.224422:0:25144:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf680000 x1875064681388928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201598.224445:0:25144:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201598.225021:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681388928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201598.225093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201598.225180:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201598.225185:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201598.225187:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201598.225193:0:493:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788201598.225196:0:493:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201598.225200:0:493:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce0a1aa3800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201598.225216:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf836c8700 x1875064681389184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201598.225236:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201598.225240:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201598.225241:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201598.225245:0:493:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788201598.225247:0:493:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201598.225250:0:493:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce087eb6000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201598.225261:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf6aa680 x1875064681389440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201598.225307:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681389184:0@lo:8:kworker.0 00000100:00100000:2.0:1788201598.225348:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.225367:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681389440:0@lo:8:kworker.0 00000100:00100000:2.0:1788201598.225387:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.225413:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681389568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201598.225435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.225454:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201598.225459:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681389696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201598.225480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.225507:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389184 00000100:00100000:2.0:1788201598.225513:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389184 00000100:00100000:2.0:1788201598.225537:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389440 00000100:00100000:2.0:1788201598.225540:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389440 00000100:00100000:2.0:1788201598.225554:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201598.225561:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681389184:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788201598.225615:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681389184:12345-0@lo:8:kworker.0 Request processed in 53us (266us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201598.225622:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201598.225648:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201598.225654:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681389440:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788201598.225683:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681389440:12345-0@lo:8:kworker.0 Request processed in 28us (295us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201598.225688:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201598.225875:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681389056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201598.225916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.225930:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681389824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201598.225954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.225973:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201598.225977:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681389312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201598.226007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.226067:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389056 00000100:00100000:2.0:1788201598.226071:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389056 00000100:00100000:2.0:1788201598.226101:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201598.226107:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681389056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201598.226156:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681389056:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.226168:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201598.226200:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201598.226206:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201598.226210:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201598.226213:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681389184:0@lo:8:kworker.0 00000100:00100000:2.0:1788201598.226222:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201598.226224:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201598.226227:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201598.226230:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681389440:0@lo:8:kworker.0 00000100:00080000:2.0:1788201598.226252:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201598.227923:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681389056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201598.228693:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681388928 00000100:00100000:3.0:1788201598.230047:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681388928 00000100:00100000:3.0:1788201598.230086:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389568 00000100:00100000:3.0:1788201598.230089:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389568 00000100:00100000:3.0:1788201598.230111:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389696 00000100:00100000:3.0:1788201598.230114:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389696 00000100:00100000:3.0:1788201598.230144:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389824 00000100:00100000:3.0:1788201598.230147:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389824 00000100:00100000:3.0:1788201598.230162:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389312 00000100:00100000:3.0:1788201598.230165:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389312 00000100:00100000:3.0:1788201598.230182:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201598.230191:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681389568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201598.230282:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681389568:12345-0@lo:400:kworker.0 Request processed in 91us (4844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.230289:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201598.230307:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201598.230314:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681389696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201598.230346:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681389696:12345-0@lo:400:kworker.0 Request processed in 32us (4865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.230352:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201598.230363:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201598.230369:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681389824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201598.230402:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681389824:12345-0@lo:400:kworker.0 Request processed in 33us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.230416:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201598.230428:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201598.230434:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681389312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201598.230464:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681389312:12345-0@lo:400:kworker.0 Request processed in 31us (4456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.230470:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201598.230481:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201598.230485:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681388928:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201598.230507:0:22805:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1788201598.230540:0:22805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf9b71aee44722005 00000004:00100000:3.0:1788201598.230555:0:22805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201598.230584:0:22805:0:(import.c:65:import_set_state_nolock()) ffff9cdf82365800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201598.230625:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875064681388928:12345-0@lo:38:llog_process_th.0 Request processed in 138us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.230631:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788201598.230833:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201598.230837:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201598.230868:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6a8380 x1875064681389696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201598.230883:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681389696:0@lo:400:kworker.0 00010000:00080000:3.0:1788201598.230895:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6ab800 x1875064681389568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201598.230925:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681389568:0@lo:400:kworker.0 00010000:00080000:3.0:1788201598.230967:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf680000 x1875064681388928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201598.230982:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201598.230989:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788201598.230997:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201598.231003:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201598.231005:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf822d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201598.231011:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875064681388928:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201598.231042:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cdf836ca300 x1875064681389312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201598.231051:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf836ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681389312:0@lo:400:kworker.0 00010000:00080000:3.0:1788201598.231064:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf6a8e00 x1875064681389824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201598.231071:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681389824:0@lo:400:kworker.0 00000020:01000004:1.0:1788201598.241226:0:25144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788201598.241246:0:25144:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9cdf820c4d40) 00000020:00000080:1.0:1788201598.241272:0:25144:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788201598.241494:0:25144:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce0ab9c2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201598.241499:0:25144:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce0ab9c2000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788201598.241501:0:25144:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce0ab9c2000 3 00010000:00080000:1.0:1788201598.241530:0:25144:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cdf821db000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1788201598.245278:0:25144:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788201598.245378:0:25144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788201598.245432:0:25144:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201598.245448:0:25144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf9b71aee44722013 00000100:00080000:1.0:1788201598.245459:0:25144:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201598.245465:0:25144:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cdf821db000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1788201598.245502:0:25144:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce0bf682a00 x1875064681389952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201598.245528:0:25144:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788201598.246134:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681389952:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201598.246201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201598.246260:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681389952 00000100:00100000:3.0:1788201598.246267:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681389952 00000100:00100000:3.0:1788201598.246296:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201598.246303:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875064681389952:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201598.246329:0:22805:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1788201598.246371:0:22805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf9b71aee4472201a 00000004:00100000:3.0:1788201598.246385:0:22805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201598.246416:0:22805:0:(import.c:65:import_set_state_nolock()) ffff9cdf82360000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201598.246465:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875064681389952:12345-0@lo:38:llog_process_th.0 Request processed in 161us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.246479:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788201598.246520:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce0bf682a00 x1875064681389952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201598.246530:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201598.246536:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788201598.246543:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201598.246548:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788201598.246550:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9cdf821db000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201598.246555:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1875064681389952:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788201598.255051:0:25144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788201598.255125:0:25131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788201598.255152:0:25131:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201598.255165:0:25131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ff0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201598.255177:0:25131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83255c00/0xf9b71aee44721fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee44721ff0 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201598.255218:0:25131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201598.255223:0:25131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201598.255224:0:25131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201598.255225:0:25131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201598.255226:0:25131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201598.255227:0:25131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201598.255228:0:25131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201598.255230:0:25131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201598.255231:0:25131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201598.255235:0:25131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788201598.255238:0:25131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201598.255239:0:25131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201598.255240:0:25131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201598.255241:0:25131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201598.255242:0:25131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201598.255242:0:25131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201598.255243:0:25131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201598.255244:0:25131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201598.255245:0:25131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201598.255271:0:25131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788201598.255290:0:25131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681390080:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201598.255357:0:25131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201598.255393:0:25131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201598.255941:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390080 00000100:00100000:2.0:1788201598.255949:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390080 00000100:00100000:2.0:1788201598.256150:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788201598.256162:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681390080:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201598.256192:0:22796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788201598.256206:0:22796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788201598.262837:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788201598.267062:0:22796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201598.267083:0:22796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788201598.269635:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:25131:x1875064681390080:12345-0@lo:253:mount.lustre.0 Request processed in 13467us (14268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.269649:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 20000000:01000000:2.0:1788201598.269920:0:22819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201598.269925:0:22819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201598.269948:0:22819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.269963:0:22819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 23 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.269971:0:22819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.269998:0:22819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.270043:0:22819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.270059:0:22819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 23 pid: 22796 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201598.270073:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681390208:0@lo:104: 00000100:00100000:2.0:1788201598.270120:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201598.270177:0:22819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 23 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.270185:0:22819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 23 pid: 22798 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201598.270193:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681390336:0@lo:104: 00000100:00100000:2.0:1788201598.270214:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.270228:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08571c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201598.270284:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390208 00000100:00100000:0.0:1788201598.270291:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390208 00000100:00100000:0.0:1788201598.270319:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390336 00000100:00100000:0.0:1788201598.270322:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390336 00000100:00100000:0.0:1788201598.270333:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201598.270339:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:22819:x1875064681390208:12345-0@lo:104: 00010000:00010000:0.0:1788201598.270352:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270421:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201598.270427:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:22819:x1875064681390208:12345-0@lo:104: Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.270434:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201598.270447:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201598.270453:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681390336:12345-0@lo:104: 00010000:00010000:0.0:1788201598.270461:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270492:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201598.270496:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:22819:x1875064681390336:12345-0@lo:104: Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.270501:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788201598.270521:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201598.270526:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270533:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afc00 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201598.270538:0:22792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270546:0:22792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201598.270553:0:22792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201598.270560:0:22792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201598.270596:0:22792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270603:0:22792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201598.270625:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270632:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0a03afc00/0xf9b71aee44721eb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721ebc expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270658:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201598.270662:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270669:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201598.270672:0:22792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270680:0:22792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201598.270687:0:22792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201598.270692:0:22792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201598.270714:0:22792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270720:0:22792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201598.270758:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270776:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce098a75000/0xf9b71aee44721ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721eae expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.270790:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201598.270791:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201598.270793:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201598.270814:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681390464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201598.270844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201598.270880:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681390592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201598.270916:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201598.270952:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390464 00000100:00100000:0.0:1788201598.270957:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390464 00010000:00010000:0.0:1788201598.270975:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 24 pid: 22796 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201598.270995:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390592 00000100:00100000:0.0:1788201598.270997:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390592 00010000:00010000:0.0:1788201598.271008:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 25 pid: 22798 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201598.271025:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201598.271032:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+25:3645:x1875064681390464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201598.271041:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201598.271047:0:22789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 25 pid: 22796 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271056:0:22789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 25 pid: 22796 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271079:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201598.271110:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+25:3645:x1875064681390464:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.271117:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201598.271130:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201598.271137:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3646:x1875064681390592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201598.271144:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201598.271149:0:22789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 24 pid: 22798 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271158:0:22789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 24 pid: 22798 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271170:0:22789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271179:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201598.271193:0:22789:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002464908s 00010000:00010000:0.0:1788201598.271198:0:22789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271204:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271211:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271229:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271235:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201598.271239:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271246:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271256:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201598.271266:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201598.271295:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3646:x1875064681390592:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201598.271302:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788201598.271329:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201598.271353:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681390464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201598.271376:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681390592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201598.271580:0:25131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:25131:1875064681390080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201598.271593:0:25131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788201598.271596:0:25131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201598.271598:0:25131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201598.271600:0:25131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201598.271601:0:25131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201598.271602:0:25131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201598.271604:0:25131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201598.271605:0:25131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201598.271607:0:25131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201598.271609:0:25131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201598.271619:0:25131:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788201598.272496:0:22819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03aea00/0xf9b71aee44721ebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721eb5 expref: 23 pid: 22796 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201598.272509:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681390208:0@lo:104: 00010000:00010000:2.0:1788201598.272519:0:22819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03afa00/0xf9b71aee44721eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721ea7 expref: 22 pid: 22798 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201598.272527:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22819:1875064681390336:0@lo:104: 00010000:00010000:2.0:1788201598.272552:0:22819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.272561:0:22819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.272567:0:22819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.272573:0:22819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03ae000/0xf9b71aee44722021 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788201598.273885:0:25131:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788201598.276531:0:25131:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788201598.276539:0:25131:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788201598.276574:0:25131:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201598.276616:0:25131:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201598.276647:0:25131:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788201598.276665:0:25131:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788201598.285675:0:25131:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201598.285983:0:25131:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788201599.232319:0:25198:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201599.232572:0:25198:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201599.286096:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201599.605853:0:22800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201599.605861:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0aafde000 from 14 10000000:01000000:0.0:1788201599.605866:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201599.605924:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44722028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.605936:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44722028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.605947:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44722028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.605973:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681390720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201599.606054:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.606102:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2663c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201599.606219:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390720 00000100:00100000:3.0:1788201599.606229:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390720 00000100:00100000:3.0:1788201599.606288:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201599.606298:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:22800:x1875064681390720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201599.606311:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201599.606325:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce098a75a00/0xf9b71aee4472202f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44722028 expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201599.606348:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce098a75a00/0xf9b71aee4472202f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44722028 expref: 23 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201599.606359:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce098a75a00/0xf9b71aee4472202f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44722028 expref: 23 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201599.606368:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a75a00, rc 0) 00000100:00100000:3.0:1788201599.606410:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681390720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.606432:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201599.606692:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681390720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201599.606708:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44722028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472202f expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.606716:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44722028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472202f expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.606847:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681390848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201599.606878:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.606949:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.608881:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390848 00000100:00100000:2.0:1788201599.608903:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390848 00000100:00100000:2.0:1788201599.609034:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201599.609045:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681390848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201599.609142:0:22796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201599.609278:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201599.609282:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788201599.609417:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681390848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 374us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.609426:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201599.609617:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681390848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788201599.609697:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201599.609706:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44722028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472202f expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.609723:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83296400/0xf9b71aee44722028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472202f expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201599.609734:0:22800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201599.609820:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ce0b62a4800 from 14 10000000:01000000:0.0:1788201599.609825:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201599.609853:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83296200/0xf9b71aee44722036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.609862:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83296200/0xf9b71aee44722036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.609872:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83296200/0xf9b71aee44722036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.609899:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681390976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201599.609934:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.609976:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.611795:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681390976 00000100:00100000:2.0:1788201599.611806:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681390976 00000100:00100000:2.0:1788201599.611859:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201599.611868:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681390976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201599.611884:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.611910:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03af200/0xf9b71aee4472203d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44722036 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.611948:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03af200/0xf9b71aee4472203d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44722036 expref: 24 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.611958:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03af200/0xf9b71aee4472203d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44722036 expref: 24 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.611966:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03af200, rc 0) 00000100:00100000:2.0:1788201599.612143:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681390976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.612150:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201599.616324:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681390976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201599.616352:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83296200/0xf9b71aee44722036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472203d expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.616365:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83296200/0xf9b71aee44722036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472203d expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.616434:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681391104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201599.616495:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.616549:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba2663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.617254:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681391104 00000100:00100000:2.0:1788201599.617261:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681391104 00000100:00100000:2.0:1788201599.617304:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788201599.617313:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681391104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201599.617332:0:22796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201599.617347:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201599.617350:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788201599.617427:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681391104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.617433:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201599.620951:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681391104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788201599.621049:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201599.621059:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83296200/0xf9b71aee44722036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472203d expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.621070:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83296200/0xf9b71aee44722036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472203d expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201599.929370:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788201600.322771:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201601.143528:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201601.143549:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681391232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201601.143611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.143765:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681391232 00000100:00100000:3.0:1788201601.143774:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681391232 00000100:00100000:3.0:1788201601.143830:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201601.143841:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681391232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201601.143872:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788201601.143928:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681391232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201601.143935:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201601.143979:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681391232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201601.144074:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201601.340355:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788201602.038452:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788201602.358907:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201603.189892:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681391360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201603.189960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.190033:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681391360 00000100:00100000:2.0:1788201603.190041:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681391360 00000100:00100000:2.0:1788201603.190082:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201603.190090:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681391360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201603.190131:0:22809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201603.190175:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681391360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.190181:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201603.190223:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681391360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201603.190656:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681391616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201603.190700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.190761:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681391616 00000100:00100000:2.0:1788201603.190765:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681391616 00000100:00100000:2.0:1788201603.190800:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201603.190807:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681391616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201603.190827:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788201603.190862:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681391616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.190879:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788201603.190895:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201603.190909:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681391488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201603.190950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.190978:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681391488 00000100:00100000:2.0:1788201603.190983:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681391488 00000100:00100000:2.0:1788201603.191004:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201603.191010:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681391488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201603.191028:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788201603.191075:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681391488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.191080:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201603.191119:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681391488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201603.191142:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681391616:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201603.386605:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201603.701937:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681391744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201603.702015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201603.702077:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681391744 00000100:00100000:3.0:1788201603.702085:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681391744 00000100:00100000:3.0:1788201603.702129:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788201603.702138:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3647:x1875064681391744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201603.702190:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3647:x1875064681391744:12345-0@lo:400:kworker.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201603.702197:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788201603.702264:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201603.702269:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201603.702272:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201603.702280:0:493:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce0a1aa3800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201603.702303:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf82397800 x1875064681392000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201603.702328:0:493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201603.702341:0:493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788201603.702343:0:493:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201603.702348:0:493:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce087eb6000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1788201603.702360:0:493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cdf82397480 x1875064681392256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201603.702421:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681392384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.702454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.702476:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681392896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201603.702488:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681391872:0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.702503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.702527:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201603.702535:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681392512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201603.702536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.702569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201603.702570:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681392640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.702604:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681392128:0@lo:400:kworker.0 00000100:00100000:1.0:1788201603.702605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.702640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.702672:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681392768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.702694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.702721:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681391872 00000100:00100000:2.0:1788201603.702724:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681391872 00000100:00080000:1.0:1788201603.702788:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201603.702801:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201603.702810:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681391872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.702855:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681391872:12345-0@lo:400:kworker.0 Request processed in 47us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.702871:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201603.702915:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392384 00000100:00100000:1.0:1788201603.702919:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681391872:0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.702920:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392384 00000100:00100000:2.0:1788201603.702945:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392896 00000100:00100000:2.0:1788201603.702949:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392896 00000100:00100000:2.0:1788201603.702984:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392512 00000100:00100000:2.0:1788201603.702987:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392512 00000100:00100000:2.0:1788201603.703000:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392640 00000100:00100000:2.0:1788201603.703002:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392640 00000100:00100000:2.0:1788201603.703012:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392128 00000100:00100000:2.0:1788201603.703014:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392128 00000100:00100000:2.0:1788201603.703023:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392768 00000100:00100000:2.0:1788201603.703025:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392768 00000100:00100000:2.0:1788201603.703040:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201603.703045:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681392384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703083:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681392384:12345-0@lo:400:kworker.0 Request processed in 37us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.703089:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201603.703100:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201603.703107:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681392896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703134:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681392896:12345-0@lo:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.703148:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201603.703159:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201603.703165:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681392512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703194:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875064681392512:12345-0@lo:400:kworker.0 Request processed in 29us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.703200:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788201603.703201:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201603.703206:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201603.703215:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201603.703222:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681392640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703260:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681392640:12345-0@lo:400:kworker.0 Request processed in 39us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.703266:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201603.703276:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201603.703282:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681392128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703311:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681392128:12345-0@lo:400:kworker.0 Request processed in 30us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.703316:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201603.703329:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201603.703335:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681392768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703359:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681392768:12345-0@lo:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.703364:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201603.703382:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681392000:0@lo:8:kworker.0 00000100:00100000:2.0:1788201603.703406:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.703423:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681392256:0@lo:8:kworker.0 00000100:00100000:2.0:1788201603.703451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788201603.703503:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82396300 x1875064681392128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201603.703509:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82394e00 x1875064681392640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201603.703516:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681392128:0@lo:400:kworker.0 00000100:00100000:1.0:1788201603.703530:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681392640:0@lo:400:kworker.0 00010000:00080000:2.0:1788201603.703538:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82397b80 x1875064681392768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201603.703547:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681392768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703580:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3647:1875064681391744:0@lo:400:kworker.0 00010000:00080000:2.0:1788201603.703603:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82394a80 x1875064681392512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201603.703611:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875064681392512:0@lo:400:kworker.0 00010000:00080000:2.0:1788201603.703620:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82395880 x1875064681392384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201603.703627:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681392384:0@lo:400:kworker.0 00010000:00080000:2.0:1788201603.703637:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf6a8e00 x1875064681392896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201603.703645:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681392896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201603.703692:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392000 00000100:00100000:2.0:1788201603.703696:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392000 00000100:00100000:2.0:1788201603.703724:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681392256 00000100:00100000:2.0:1788201603.703727:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681392256 00000100:00100000:2.0:1788201603.703762:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201603.703767:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf836c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875064681392000:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788201603.703780:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201603.703788:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875064681392256:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788201603.703805:0:24314:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00010000:00080000:1.0:1788201603.703809:0:24313:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:2.0:1788201603.703842:0:24314:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf9b71aee44722044 00000020:00000080:1.0:1788201603.703843:0:24313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf9b71aee4472204b 00002000:00100000:2.0:1788201603.708121:0:24314:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cdf81ad7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788201603.708134:0:24314:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788201603.708137:0:24314:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201603.709324:0:24314:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201603.709422:0:24314:0:(import.c:65:import_set_state_nolock()) ffff9cdf81ad7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201603.709603:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf836c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875064681392000:12345-0@lo:8:kworker.0 Request processed in 5831us (6192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.709616:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00100000:1.0:1788201603.709630:0:24313:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9cdf822d3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788201603.709637:0:24313:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788201603.709640:0:24313:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201603.709687:0:24313:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788201603.709703:0:24313:0:(import.c:65:import_set_state_nolock()) ffff9cdf822d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201603.709752:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875064681392256:12345-0@lo:8:kworker.0 Request processed in 5949us (6285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201603.709776:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788201603.721373:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82397800 x1875064681392000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201603.721395:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788201603.721417:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201603.721423:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201603.721426:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce0a1aa3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201603.721458:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201603.721466:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875064681392000:0@lo:8:kworker.0 00010000:00080000:3.0:1788201603.721491:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82397480 x1875064681392256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201603.721502:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788201603.721508:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201603.721511:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201603.721513:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ce087eb6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201603.721522:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201603.721526:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875064681392256:0@lo:8:kworker.0 00000004:00080000:1.0:1788201603.722189:0:22830:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788201603.722212:0:22830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22830:1875064681393152:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201603.722270:0:22830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201603.722297:0:22830:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501ad80 going to sleep for 11 seconds 00000004:00080000:1.0:1788201603.722334:0:23548:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788201603.722486:0:23548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23548:1875064681393408:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788201603.722513:0:23548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201603.722527:0:23548:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce08501acc0 going to sleep for 11 seconds 00000004:00080000:1.0:1788201603.722543:0:23547:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201603.722631:0:23547:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 684019892228ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201603.722637:0:23547:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788201603.722660:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201603.722670:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681393024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201603.722697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201603.722721:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201603.722730:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681393280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201603.722775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201603.722964:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393152 00000100:00100000:3.0:1788201603.722972:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393152 00000100:00100000:3.0:1788201603.723016:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393408 00000100:00100000:3.0:1788201603.723019:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393408 00000100:00100000:3.0:1788201603.723043:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201603.723052:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22830:x1875064681393152:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788201603.723265:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201603.723274:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23548:x1875064681393408:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1788201603.723317:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788201603.724438:0:22829:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201603.724514:0:22829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 684021774103ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201603.724521:0:22829:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788201603.724665:0:24316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393024 00000100:00100000:2.0:1788201603.724672:0:24316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393024 00000100:00100000:2.0:1788201603.724699:0:24316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393280 00000100:00100000:2.0:1788201603.724703:0:24316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393280 00000100:00100000:2.0:1788201603.724716:0:24316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201603.724723:0:24316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681393024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201603.724760:0:24316:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788201603.724827:0:24316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875064681393024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2129us total) trans 0 rc 0/0 00010000:00080000:1.0:1788201603.724959:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf680700 x1875064681393024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201603.724978:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681393024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201603.725145:0:24316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201603.725163:0:24316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201603.725170:0:24316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875064681393280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201603.725181:0:24316:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788201603.725935:0:24316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875064681393280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 763us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201603.725951:0:24316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788201603.726040:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf682a00 x1875064681393280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201603.726056:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681393280:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788201603.732811:0:22783:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788201603.734445:0:24846:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788201603.734454:0:24846:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788201603.734459:0:24846:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:3.0:1788201603.738216:0:24311:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788201603.738228:0:24311:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788201603.738333:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23548:x1875064681393408:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15057us (15815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201603.738343:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788201603.738431:0:23548:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0bf680000 x1875064681393408/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201619 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201603.738446:0:23548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23548:1875064681393408:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788201603.738460:0:23548:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788201603.738500:0:23548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23548:1875064681393536:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788201603.738535:0:23548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201603.738558:0:23548:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201603.738577:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393536 00000100:00100000:3.0:1788201603.738583:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393536 00000100:00100000:3.0:1788201603.738619:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201603.738626:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23548:x1875064681393536:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788201603.738651:0:24314:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788201603.738698:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23548:x1875064681393536:12345-0@lo:5:osp-pre-1-1.0 Request processed in 72us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201603.738704:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788201603.738727:0:23548:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf8410df80 x1875064681393536/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201619 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201603.738754:0:23548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23548:1875064681393536:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788201603.738762:0:23548:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788201603.738785:0:23548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23548:1875064681393664:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788201603.738807:0:23548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201603.738823:0:23548:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201603.738839:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393664 00000100:00100000:3.0:1788201603.738843:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393664 00000100:00100000:3.0:1788201603.738880:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201603.738887:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23548:x1875064681393664:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788201603.738920:0:24313:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:3.0:1788201603.739073:0:23536:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:3.0:1788201603.755938:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.755950:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.755968:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.755973:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.755980:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756008:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756019:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756028:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756048:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201603.756058:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201603.756064:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756071:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201603.756075:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756092:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756109:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756116:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000194bfa74/0xf9b71aee44722052 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.756134:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.756136:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.756138:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.758598:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.758609:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758625:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.758630:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.758637:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758651:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758661:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758677:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758695:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201603.758706:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201603.758712:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758720:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201603.758725:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758733:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758767:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758774:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046cc19ec/0xf9b71aee44722059 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.758793:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.758795:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.758796:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.759119:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.759132:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759141:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.759145:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.759149:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759158:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759165:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759172:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759186:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201603.759194:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201603.759198:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759204:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201603.759208:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759216:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759234:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759241:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000234ad367/0xf9b71aee44722060 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759266:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.759268:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.759270:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.759731:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.759760:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759770:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.759773:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.759778:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759787:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759795:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759801:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759825:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201603.759832:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201603.759836:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759842:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201603.759846:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759854:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759875:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.759883:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722067 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.760086:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.760088:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.760090:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.763670:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.763685:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763703:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.763723:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.763729:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763759:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763770:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763777:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763797:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201603.763808:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201603.763813:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763821:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201603.763826:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763834:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763849:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763880:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a588e9/0xf9b71aee4472206e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.763910:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.763912:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.763914:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201603.764690:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201603.764700:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.764711:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788201603.764715:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201603.764719:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.764729:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.764763:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.764771:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.764795:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201603.764990:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201603.764996:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.765005:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201603.765010:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.765018:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.765032:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.765039:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4c9bd5f/0xf9b71aee44722075 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.765055:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.765056:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.765058:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201603.766559:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201603.766570:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.766585:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788201603.766590:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201603.766595:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.766607:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.766617:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.766624:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.766641:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201603.767083:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201603.767090:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.767099:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:3.0:1788201603.767103:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.767113:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.767252:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.767262:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee4472207c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.767279:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.767282:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.767283:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.768287:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.768296:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.768309:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.768314:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.768318:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.768343:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.768352:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.768359:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.768383:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201603.768723:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.768730:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.768758:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.768769:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.768778:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.768792:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.768799:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000961bdb08/0xf9b71aee44722083 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.768820:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.768821:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.768823:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.769571:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.769579:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.769591:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.769594:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.769601:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.769612:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.769620:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.769638:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.769664:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201603.769733:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201603.769759:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.770012:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201603.770018:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.770028:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.770049:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.770058:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008628fe7/0xf9b71aee4472208a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.770079:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.770082:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.770084:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.770085:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.770092:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.770101:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.770104:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.770108:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.770117:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.770124:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.770131:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.770144:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201603.770357:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.770363:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.770371:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.770374:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.770382:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.770392:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.770407:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411a7a9e/0xf9b71aee44722091 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.770422:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.770424:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.770426:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.774624:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.774639:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.774666:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.774672:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.774678:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.774692:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.774701:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.774709:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.774734:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201603.775087:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201603.775097:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.775115:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201603.775120:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.775130:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.775149:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.775157:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d402b7/0xf9b71aee44722098 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.775181:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.775184:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.775186:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.780912:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.780926:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.780943:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.780948:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.780954:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.780968:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.780995:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.781003:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.781023:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201603.781718:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.781727:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.781767:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.781772:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.781782:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.781800:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.781806:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472209f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.781824:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.781825:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.781827:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788201603.782764:0:25132:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788201603.782786:0:25132:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788201603.782790:0:25132:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201603.783010:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23548:x1875064681393664:12345-0@lo:5:osp-pre-1-1.0 Request processed in 44120us (44198us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788201603.783020:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201603.783152:0:23548:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788201603.783161:0:23548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23548:1875064681393664:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788201603.783175:0:23548:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1788201603.783223:0:23548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23548:1875064681393792:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788201603.783260:0:23548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.783302:0:23548:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf81929900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201603.783428:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393792 00000100:00100000:0.0:1788201603.783435:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393792 00000100:00100000:0.0:1788201603.783475:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201603.783483:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23548:x1875064681393792:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788201603.783533:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23548:x1875064681393792:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201603.783540:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788201603.783568:0:23548:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834cdf80 x1875064681393792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201619 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201603.783580:0:23548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23548:1875064681393792:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788201603.784347:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201603.784355:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.784371:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788201603.784375:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201603.784381:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.784394:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.784403:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.784419:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.784477:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201603.785250:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201603.785258:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785271:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201603.785275:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785286:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785305:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785312:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000270d242b/0xf9b71aee447220a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785335:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.785338:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.785339:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201603.785877:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.785889:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785900:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.785905:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.785911:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785931:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785940:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785948:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.785968:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201603.786245:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.786252:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786261:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aee00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.786265:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786275:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786289:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786297:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a857339/0xf9b71aee447220ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786312:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.786314:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.786316:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201603.786714:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.786722:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.786732:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.786736:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.786814:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.786825:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.786833:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.786852:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.786883:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201603.786915:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.786927:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786936:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afc00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.786940:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786948:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786961:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786968:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff82139/0xf9b71aee447220b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.786981:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.786983:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.786984:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201603.787539:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.787546:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.787556:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.787560:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.787564:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.787573:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.787581:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.787587:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.787610:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201603.787983:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.787989:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788038:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.788044:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788053:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae000 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.788057:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788077:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788090:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788098:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000629faece/0xf9b71aee447220bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788115:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.788116:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.788118:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.788164:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.788167:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.788172:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788183:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788191:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788199:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788216:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201603.788522:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.788528:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788537:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.788540:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.788544:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788554:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788573:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788580:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.788592:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201603.788728:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201603.788734:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788762:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afa00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.788766:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788774:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788786:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788804:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5f41a25/0xf9b71aee447220c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788818:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.788822:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788828:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aea00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.788832:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788839:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788849:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788857:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058a74e9e/0xf9b71aee447220c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.788878:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.788880:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.788882:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.788887:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201603.789108:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.789115:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789125:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.789197:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.789201:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789211:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789220:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789227:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789289:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201603.789853:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.789859:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789879:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.789883:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.789888:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789897:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789904:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.789912:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.789968:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201603.789974:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.789987:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03ae400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.789991:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.789999:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790012:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790018:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d98aab7/0xf9b71aee447220d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790032:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.790035:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790040:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.790042:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790048:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790056:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790069:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.790070:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.790072:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.790144:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201603.790149:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103d58bf/0xf9b71aee447220d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201603.790586:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.790592:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.790608:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.790610:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.790615:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.790623:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.790630:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.790637:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790782:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.790875:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790885:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03aec00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.790889:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790897:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790909:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.790917:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.790918:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.790920:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.790995:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201603.791001:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001c7f168/0xf9b71aee447220de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201603.791409:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.791416:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.791425:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.791428:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.791433:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.791453:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.791462:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.791469:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.791494:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.791499:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.791507:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.791510:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.791523:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.791533:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.791541:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.791543:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.791545:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.791600:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201603.791605:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c75c4a/0xf9b71aee447220e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201603.792070:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.792077:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792086:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.792089:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.792094:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792104:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792123:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792141:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792241:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.792246:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792254:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.792257:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792266:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792278:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792287:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.792288:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.792290:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.792353:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201603.792358:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e03503/0xf9b71aee447220ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201603.792686:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.792692:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792702:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.792705:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.792709:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792719:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792727:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.792765:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792878:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.792884:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792892:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.792895:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792902:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792913:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.792921:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.792922:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.792924:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.792979:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201603.792984:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a9da77/0xf9b71aee447220f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201603.793546:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.793554:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.793565:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.793569:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.793574:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.793584:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.793593:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.793601:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.793640:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.793645:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.793653:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855baa00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.793710:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.793721:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.793788:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.793797:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.793798:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.793800:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.793943:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201603.793948:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9eb4617/0xf9b71aee447220fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201603.794356:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201603.794363:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.794372:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788201603.794375:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201603.794379:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.794388:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.794396:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.794403:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.794597:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.794603:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.794611:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbe00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.794614:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.794621:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.794633:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.794640:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.794642:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.794644:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.794730:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201603.794735:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e7c2874/0xf9b71aee44722101 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.795047:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.795550:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.795558:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.795569:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.795573:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.795578:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.795587:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.795594:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.795601:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.795634:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201603.795722:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.795728:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796023:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1600 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.796027:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796035:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796048:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796055:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d0bcc8/0xf9b71aee44722108 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796071:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.796073:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.796075:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.796218:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.796223:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796232:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.796235:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.796239:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796247:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796253:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796260:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796277:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201603.796471:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.796476:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796483:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1c00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.796486:0:22792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796493:0:22792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796511:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796518:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d38edc5c/0xf9b71aee4472210f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.796531:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.796533:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.796535:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201603.796599:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.796604:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796612:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.796620:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.796624:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796632:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796639:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796645:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.796733:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201603.797049:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201603.797055:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.797064:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788201603.797067:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201603.797071:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.797080:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.797087:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201603.797101:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797248:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201603.797254:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797261:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0e00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.797265:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797273:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797286:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797293:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b4cba4/0xf9b71aee44722116 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797320:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201603.797323:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797329:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201603.797332:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797340:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797350:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201603.797357:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.797358:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.797360:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.797417:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201603.797423:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008f30fe5/0xf9b71aee4472211d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201603.798201:0:24846:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201603.798210:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201603.798222:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788201603.798227:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201603.798232:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201603.798244:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201603.798253:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201603.798260:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201603.800854:0:24846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201603.800900:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201603.800911:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.800925:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255a00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201603.800931:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.800942:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.800962:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201603.800970:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddca18c8/0xf9b71aee44722124 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788201603.800970:0:24846:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:2.0:1788201603.800996:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.800999:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201603.801001:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201603.801074:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201603.801087:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22830:x1875064681393152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 78031us (78811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201603.801115:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201603.801151:0:22830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22830:1875064681393152:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201603.801166:0:22830:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788201603.801209:0:22830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22830:1875064681393920:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201603.801249:0:22830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201603.801284:0:22830:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b96c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201603.801790:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681393920 00000100:00100000:0.0:1788201603.801796:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681393920 00000100:00100000:0.0:1788201603.801833:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201603.801842:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22830:x1875064681393920:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788201603.801891:0:24314:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1788201603.804975:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22830:x1875064681393920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3129us (3720us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788201603.804987:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201603.805047:0:22830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22830:1875064681393920:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788201603.805060:0:22830:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1788201604.408124:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201604.410404:0:25487:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1788201605.295786:0:25540:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201605.296572:0:25540:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201605.429845:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201606.093968:0:25590:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201606.094212:0:25590:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201606.263000:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681394048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201606.263077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201606.265028:0:24316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394048 00000100:00100000:2.0:1788201606.265040:0:24316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394048 00000100:00100000:2.0:1788201606.265109:0:24316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201606.265120:0:24316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681394048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201606.265151:0:24316:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788201606.265227:0:24316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681394048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.265235:0:24316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788201606.265289:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201606.265608:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681394048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201606.405653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201606.408689:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407168 00000100:00100000:3.0:1788201606.408703:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407168 00000100:00100000:2.0:1788201606.412213:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:2.0:1788201606.412225:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1875064662407168:12345-192.168.203.2@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788201606.412258:0:22797:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from faacd08d-6bc4-48af-a10c-977150f7f541@192.168.203.2@tcp t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1788201606.412288:0:22797:0:(genops.c:1406:class_connect()) connect: client faacd08d-6bc4-48af-a10c-977150f7f541, cookie 0xf9b71aee4472212b 00000100:00080000:2.0:1788201606.412442:0:22797:0:(import.c:65:import_set_state_nolock()) ffff9cdf81ad5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201606.412532:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+5:2397:x1875064662407168:12345-192.168.203.2@tcp:250:mount.lustre.0 Request processed in 306us (6888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.412539:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:1.0:1788201606.420329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201606.420784:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407296 00000100:00100000:3.0:1788201606.420794:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407296 00000100:00100000:3.0:1788201606.420863:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:3.0:1788201606.420873:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+5:18068:x1875064662407296:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201606.420890:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201606.420907:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44722132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc5b3 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201606.420948:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44722132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5b3 expref: 6 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201606.420959:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0816a0200/0xf9b71aee44722132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5b3 expref: 6 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201606.420969:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a0200, rc 0) 00000100:00100000:3.0:1788201606.421033:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+6:18068:x1875064662407296:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 161us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.421058:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:1.0:1788201606.426947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.427117:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407424 00000100:00100000:2.0:1788201606.427130:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407424 00000100:00100000:2.0:1788201606.427197:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:2.0:1788201606.427210:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+6:18068:x1875064662407424:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201606.427408:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0391450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+6:18068:x1875064662407424:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 199us (473us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201606.427417:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:2.0:1788201606.446152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201606.446323:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407552 00000100:00100000:0.0:1788201606.446336:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407552 00000100:00100000:0.0:1788201606.446405:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:0.0:1788201606.446417:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+6:18068:x1875064662407552:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201606.446442:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201606.446467:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83297c00/0xf9b71aee44722139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc5ba expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.446502:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83297c00/0xf9b71aee44722139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5ba expref: 7 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.446514:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83297c00/0xf9b71aee44722139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5ba expref: 7 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.446524:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83297c00, rc 0) 00000100:00100000:0.0:1788201606.446597:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+7:18068:x1875064662407552:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 182us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.446605:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:1.0:1788201606.453655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.455142:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407680 00000100:00100000:2.0:1788201606.455159:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407680 00000100:00100000:2.0:1788201606.455230:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:2.0:1788201606.455241:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+7:18068:x1875064662407680:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201606.455454:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0391050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+8:18068:x1875064662407680:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 213us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.455464:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 119 00010000:00010000:3.0:1788201606.455967:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201606.460519:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.460615:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407808 00000100:00100000:2.0:1788201606.460628:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407808 00000100:00100000:2.0:1788201606.461704:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:2.0:1788201606.461723:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+8:18068:x1875064662407808:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788201606.461972:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+8:18068:x1875064662407808:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 257us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.461981:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:2.0:1788201606.471128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201606.471523:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662407936 00000100:00100000:0.0:1788201606.471537:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662407936 00000100:00100000:0.0:1788201606.471607:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:0.0:1788201606.471619:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+8:18086:x1875064662407936:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201606.471920:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+8:18086:x1875064662407936:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 301us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.471930:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:1.0:1788201606.498930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.501555:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408064 00000100:00100000:2.0:1788201606.501576:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408064 00000100:00100000:2.0:1788201606.501822:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:2.0:1788201606.501836:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0391c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+8:18086:x1875064662408064:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201606.502070:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0391c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+8:18086:x1875064662408064:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 237us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.502079:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:1.0:1788201606.508860:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201606.510007:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408192 00000100:00100000:3.0:1788201606.510024:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408192 00000100:00100000:3.0:1788201606.510095:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:3.0:1788201606.510107:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+8:18086:x1875064662408192:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201606.510322:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+8:18086:x1875064662408192:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 216us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.510331:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:3.0:1788201606.522174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.522386:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408320 00000100:00100000:2.0:1788201606.522400:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408320 00000100:00100000:2.0:1788201606.522467:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:2.0:1788201606.522495:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+8:18068:x1875064662408320:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788201606.522519:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201606.522542:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44722140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc5eb expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201606.522577:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44722140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5eb expref: 9 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201606.522590:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bb800/0xf9b71aee44722140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5eb expref: 9 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201606.522601:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb800, rc 0) 00000100:00100000:2.0:1788201606.522688:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+9:18068:x1875064662408320:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 195us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.522697:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:1.0:1788201606.530941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201606.531262:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408448 00000100:00100000:0.0:1788201606.531275:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408448 00000100:00100000:0.0:1788201606.531347:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:0.0:1788201606.531359:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0393850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+9:18068:x1875064662408448:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788201606.531393:0:22796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788201606.531426:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788201606.531431:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788201606.531434:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788201606.531438:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788201606.531440:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788201606.537073:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0393850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+9:18068:x1875064662408448:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 5700us (6131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.537091:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:3.0:1788201606.542310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.542634:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408576 00000100:00100000:2.0:1788201606.542710:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408576 00000100:00100000:2.0:1788201606.543015:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:2.0:1788201606.543027:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+9:18068:x1875064662408576:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788201606.543050:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201606.543073:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc5f2 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201606.543111:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 10 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201606.543124:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 10 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201606.543158:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb000, rc 0) 00000100:00100000:2.0:1788201606.543284:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0390450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+10:18068:x1875064662408576:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 259us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.543292:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:1.0:1788201606.550938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201606.551112:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408704 00000100:00100000:0.0:1788201606.551126:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408704 00000100:00100000:0.0:1788201606.551198:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:0.0:1788201606.551211:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0a0392850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+10:18068:x1875064662408704:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788201606.551411:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0a0392850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+10:18068:x1875064662408704:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 203us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.551421:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:1.0:1788201606.560550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201606.563532:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408832 00000100:00100000:0.0:1788201606.563556:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408832 00000100:00100000:0.0:1788201606.563673:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:0.0:1788201606.563706:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce088958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+10:18068:x1875064662408832:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788201606.564246:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce088958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+10:18068:x1875064662408832:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 540us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.564255:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:2.0:1788201606.583372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201606.583706:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662408960 00000100:00100000:3.0:1788201606.583719:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662408960 00000100:00100000:3.0:1788201606.583816:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:3.0:1788201606.583828:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce088959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+10:18091:x1875064662408960:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201606.584124:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce088959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+10:18091:x1875064662408960:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 295us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201606.584134:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:1.0:1788201606.593044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.593208:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409088 00000100:00100000:2.0:1788201606.593222:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409088 00000100:00100000:2.0:1788201606.593294:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:2.0:1788201606.593306:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+10:18091:x1875064662409088:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201606.594945:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+10:18091:x1875064662409088:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 1630us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.594959:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:2.0:1788201606.608318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.608547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201606.609199:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409216 00000100:00100000:3.0:1788201606.609211:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409216 00000100:00100000:3.0:1788201606.609259:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409472 00000100:00100000:3.0:1788201606.609262:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409472 00000100:00100000:3.0:1788201606.610788:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:3.0:1788201606.610803:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875064662409216:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788201606.610867:0:22802:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from a02e8f03-e864-49bb-8879-8d6d5f03b6c1@192.168.203.2@tcp t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:3.0:1788201606.610951:0:22802:0:(genops.c:1406:class_connect()) connect: client a02e8f03-e864-49bb-8879-8d6d5f03b6c1, cookie 0xf9b71aee4472214e 00000004:00100000:3.0:1788201606.610986:0:22802:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788201606.611229:0:22802:0:(import.c:65:import_set_state_nolock()) ffff9cdf82363000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201606.611351:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2397:x1875064662409216:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 547us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.611359:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:3.0:1788201606.611382:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1788201606.611387:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875064662409472:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788201606.611404:0:22802:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from a02e8f03-e864-49bb-8879-8d6d5f03b6c1@192.168.203.2@tcp t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:3.0:1788201606.611689:0:22802:0:(genops.c:1406:class_connect()) connect: client a02e8f03-e864-49bb-8879-8d6d5f03b6c1, cookie 0xf9b71aee44722155 00000004:00100000:3.0:1788201606.611707:0:22802:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788201606.611995:0:22802:0:(import.c:65:import_set_state_nolock()) ffff9ce09d407800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201606.612027:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2397:x1875064662409472:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 639us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.612034:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:2.0:1788201606.620392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201606.620625:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409728 00000100:00100000:1.0:1788201606.620637:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409728 00000100:00100000:1.0:1788201606.620831:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1788201606.620860:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662409728:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788201606.620912:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788201606.621020:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662409728:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 178us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201606.621029:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00080000:3.0:1788201606.623044:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201606.623671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201606.623853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201606.627857:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.628171:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409344 00000100:00100000:0.0:1788201606.628171:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409600 00000100:00100000:2.0:1788201606.628184:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409344 00000100:00100000:0.0:1788201606.628184:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409600 00000100:00100000:2.0:1788201606.628252:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:0.0:1788201606.628259:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:2.0:1788201606.628263:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:0:x1875064662409600:12345-192.168.203.2@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788201606.628265:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:0:x1875064662409344:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201606.628302:0:22805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000004:00000024:2.0:1788201606.628309:0:22802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201606.628393:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:0:x1875064662409600:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 131us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.628401:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:0.0:1788201606.628418:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:0:x1875064662409344:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 153us (4576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.628424:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00080000:0.0:1788201606.628451:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201606.628915:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409856 00000100:00100000:0.0:1788201606.628920:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409856 00000100:00100000:0.0:1788201606.628960:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:0.0:1788201606.628968:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662409856:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788201606.629022:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662409856:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 55us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.629029:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1788201606.635857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.636011:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.636056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201606.636216:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662410240 00000100:00100000:1.0:1788201606.636229:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662410240 00000100:00100000:1.0:1788201606.636302:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1788201606.636315:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662410240:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788201606.636427:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662410240:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 115us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201606.636436:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1788201606.641423:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662409984 00000100:00100000:3.0:1788201606.641444:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662409984 00000100:00100000:3.0:1788201606.641516:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662410112 00000100:00100000:3.0:1788201606.641520:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662410112 00000100:00100000:3.0:1788201606.641561:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1788201606.641571:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875064662409984:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788201606.641690:0:24846:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from a02e8f03-e864-49bb-8879-8d6d5f03b6c1@192.168.203.2@tcp t0 exp 0000000000000000 cur 686 last 0 00000100:00100000:2.0:1788201606.641861:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1788201606.641869:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875064662410112:12345-192.168.203.2@tcp:8:mount.lustre.0 00000020:00000080:3.0:1788201606.641901:0:24846:0:(genops.c:1406:class_connect()) connect: client a02e8f03-e864-49bb-8879-8d6d5f03b6c1, cookie 0xf9b71aee4472215c 00010000:00080000:2.0:1788201606.641902:0:24311:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from a02e8f03-e864-49bb-8879-8d6d5f03b6c1@192.168.203.2@tcp t0 exp 0000000000000000 cur 686 last 0 00002000:00100000:3.0:1788201606.641921:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a02e8f03-e864-49bb-8879-8d6d5f03b6c1/ffff9ce09d406000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:2.0:1788201606.641933:0:24311:0:(genops.c:1406:class_connect()) connect: client a02e8f03-e864-49bb-8879-8d6d5f03b6c1, cookie 0xf9b71aee44722163 00002000:00100000:3.0:1788201606.641938:0:24846:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1788201606.641942:0:24311:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a02e8f03-e864-49bb-8879-8d6d5f03b6c1/ffff9cdf81ad2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201606.641961:0:24311:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788201606.642260:0:24311:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:3.0:1788201606.642261:0:24846:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201606.642320:0:24311:0:(import.c:65:import_set_state_nolock()) ffff9cdf81ad0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201606.642412:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2397:x1875064662410112:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 542us (6354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.642421:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1788201606.642507:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201606.642717:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662410368 00000100:00100000:2.0:1788201606.642725:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662410368 00000100:00100000:2.0:1788201606.642809:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1788201606.642817:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662410368:12345-192.168.203.2@tcp:33:mount.lustre.0 00000100:00080000:3.0:1788201606.643067:0:24846:0:(import.c:65:import_set_state_nolock()) ffff9ce09d404000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201606.643116:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2397:x1875064662409984:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 1545us (7285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.643125:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000004:00080000:3.0:1788201606.643909:0:22806:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 983us 00000004:00200000:0.0:1788201606.669485:0:22806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788201606.669913:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18068:x1875064662410368:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 27086us (27396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.669932:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1788201606.848496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201606.850803:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662410496 00000100:00100000:0.0:1788201606.850856:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662410496 00000100:00100000:0.0:1788201606.850948:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1788201606.850960:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18114:x1875064662410496:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:0.0:1788201606.850986:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201606.851017:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296600/0xf9b71aee4472216a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc623 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.851099:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297600/0xf9b71aee44722171 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.851115:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297600/0xf9b71aee44722171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.851131:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297600/0xf9b71aee44722171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201606.851192:0:22805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201606.851197:0:22805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201606.851241:0:22805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297600/0xf9b71aee44722171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.851276:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296600/0xf9b71aee4472216a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc623 expref: 8 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.851299:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297600/0xf9b71aee44722171 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc623 expref: 7 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201606.851310:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:0.0:1788201606.851314:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201606.851318:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83297600, rc 0) 00000100:00100000:0.0:1788201606.851417:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18114:x1875064662410496:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 458us (2934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.851425:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00010000:00010000:0.0:1788201607.480864:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201608.310553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201608.310584:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681394432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201608.310673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681394176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201608.310681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201608.310725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.310851:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681394304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201608.310887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.310977:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394432 00000100:00100000:1.0:1788201608.310987:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394432 00000100:00100000:1.0:1788201608.311042:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394176 00000100:00100000:1.0:1788201608.311045:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394176 00000100:00100000:1.0:1788201608.311065:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201608.311075:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681394432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201608.311119:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788201608.311200:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201608.311212:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681394176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201608.311234:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788201608.315771:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681394432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4666us (5061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.315791:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201608.315918:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394304 00000100:00100000:1.0:1788201608.315931:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394304 00000100:00100000:1.0:1788201608.316026:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201608.316042:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681394304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201608.316098:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201608.316295:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681394304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 258us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.316303:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201608.316362:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681394304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201608.316405:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201608.316463:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681394432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201608.316631:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681394176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5421us (5904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201608.316642:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201608.322489:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681394176:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788201608.503798:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201608.743196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201608.743301:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662410624 00000100:00100000:1.0:1788201608.743313:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662410624 00000100:00100000:1.0:1788201608.743400:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1788201608.743412:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18166:x1875064662410624:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:1.0:1788201608.743461:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:0.0:1788201608.743621:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201608.743686:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18166:x1875064662410624:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 276us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.743702:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1788201608.752000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201608.752290:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662410752 00000100:00100000:0.0:1788201608.752304:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662410752 00000100:00100000:0.0:1788201608.752443:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:0.0:1788201608.752455:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18166:x1875064662410752:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:0.0:1788201608.752501:0:22805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788201608.752610:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18166:x1875064662410752:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 156us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201608.752618:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00080000:1.0:1788201608.756049:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201608.756510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201608.756590:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662410880 00000100:00100000:1.0:1788201608.756601:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662410880 00000100:00100000:1.0:1788201608.756852:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1788201608.756865:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18166:x1875064662410880:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:1.0:1788201608.756899:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201608.757031:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18166:x1875064662410880:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 168us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.757039:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00080000:0.0:1788201608.757499:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201608.760212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201608.765213:0:24316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411008 00000100:00100000:2.0:1788201608.765235:0:24316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411008 00000100:00100000:2.0:1788201608.765407:0:24316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1788201608.765420:0:24316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18166:x1875064662411008:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:2.0:1788201608.765463:0:24316:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788201608.765604:0:24316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18166:x1875064662411008:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 187us (5406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.765612:0:24316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00080000:0.0:1788201608.765720:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201608.823424:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201608.823453:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681394560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201608.823585:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681394816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201608.823592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201608.823711:0:24316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394560 00000100:00100000:2.0:1788201608.823721:0:24316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394560 00000100:00100000:2.0:1788201608.823845:0:24316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201608.823856:0:24316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681394560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201608.823885:0:24316:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00080000:3.0:1788201608.826111:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201608.826155:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681395072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201608.828941:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681394944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201608.829041:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201608.829081:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681395456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201608.829106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201608.829147:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681395968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201608.829176:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.829251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.829440:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394816 00000100:00100000:1.0:1788201608.829450:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394816 00000100:00100000:1.0:1788201608.829512:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201608.829991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201608.830025:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681395584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201608.830056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201608.830080:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681396096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.830092:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681394816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201608.830108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201608.830169:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394944 00000100:00100000:1.0:1788201608.830170:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681394816:12345-0@lo:400:kworker.0 Request processed in 84us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.830183:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201608.830225:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395456 00000100:00100000:1.0:1788201608.830229:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395456 00000100:00100000:2.0:1788201608.830268:0:24316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681394560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6412us (6685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.830279:0:24316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201608.830318:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395072 00000100:00100000:1.0:1788201608.830322:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395072 00000100:00100000:1.0:1788201608.830523:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395584 00000100:00100000:1.0:1788201608.830528:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395584 00000100:00100000:2.0:1788201608.830545:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681394688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201608.830586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201608.830617:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681395200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201608.830641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.830647:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201608.830661:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681395712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.830663:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681395456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.830706:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681395456:12345-0@lo:400:kworker.0 Request processed in 49us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.830713:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201608.830724:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201608.830730:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681395072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.830869:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681395072:12345-0@lo:400:kworker.0 Request processed in 138us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.830876:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201608.830888:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201608.830895:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681395584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.830922:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681395584:12345-0@lo:400:kworker.0 Request processed in 28us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.830928:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788201608.830946:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201608.830959:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395968 00000100:00100000:1.0:1788201608.830963:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395968 00000100:00100000:1.0:1788201608.830996:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396096 00000100:00100000:1.0:1788201608.830999:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396096 00000100:00100000:1.0:1788201608.831017:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395200 00000100:00100000:1.0:1788201608.831020:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395200 00000100:00100000:1.0:1788201608.831033:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201608.831040:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394944 00000100:00100000:3.0:1788201608.831078:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201608.831086:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681394944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201608.831122:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681394944:12345-0@lo:400:kworker.0 Request processed in 38us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201608.831129:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201608.831174:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681394816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831335:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681395968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831374:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875064681395968:12345-0@lo:400:kworker.0 Request processed in 45us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.831381:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201608.831395:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201608.831402:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681396096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831433:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875064681396096:12345-0@lo:400:kworker.0 Request processed in 30us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.831437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.831444:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201608.831458:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395712 00000100:00100000:1.0:1788201608.831462:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395712 00000100:00100000:2.0:1788201608.831466:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681396224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831480:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201608.831488:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681395200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201608.831499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.831533:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875064681395200:12345-0@lo:400:kworker.0 Request processed in 46us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.831538:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875064681395200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831545:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201608.831559:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201608.831567:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681396352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201608.831591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201608.831619:0:24316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396352 00000100:00100000:2.0:1788201608.831623:0:24316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396352 00000100:00100000:2.0:1788201608.831653:0:24316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201608.831658:0:24316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681396352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201608.831718:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396224 00000100:00100000:1.0:1788201608.831721:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396224 00000100:00100000:3.0:1788201608.831763:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681395328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831772:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201608.831782:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681395712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201608.831799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201608.831836:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681395840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831847:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875064681395712:12345-0@lo:400:kworker.0 Request processed in 67us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.831853:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201608.831865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201608.831870:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201608.831879:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681396224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831913:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875064681396224:12345-0@lo:400:kworker.0 Request processed in 37us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201608.831925:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681395072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831930:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201608.831947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681395584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831947:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395840 00000100:00100000:1.0:1788201608.831952:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395840 00000100:00100000:3.0:1788201608.831967:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875064681396096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.831975:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201608.831984:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681395840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201608.832003:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681395328 00000100:00100000:3.0:1788201608.832009:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681395328 00000100:00100000:1.0:1788201608.832023:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681395840:12345-0@lo:400:kworker.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.832030:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201608.832047:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201608.832055:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681395328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201608.832108:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681395328:12345-0@lo:400:kworker.0 Request processed in 53us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201608.832115:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788201608.832140:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201608.832145:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681395328:0@lo:400:kworker.0 00000100:00080000:1.0:1788201608.832149:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201608.832158:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681395840:0@lo:400:kworker.0 00000100:00080000:1.0:1788201608.832217:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201608.832240:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681394688 00000100:00100000:1.0:1788201608.832245:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681394688 00000100:00100000:1.0:1788201608.832279:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201608.832286:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3646:x1875064681394688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.832321:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3646:x1875064681394688:12345-0@lo:400:kworker.0 Request processed in 36us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.832327:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201608.832401:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681394944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.832416:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681395456:0@lo:400:kworker.0 00010000:00080000:1.0:1788201608.832433:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c8b800 x1875064681395968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201608.832445:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875064681395968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201608.832468:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0ba3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681394560:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201608.832552:0:24316:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788201608.832591:0:24316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875064681396352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 931us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.832599:0:24316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201608.832633:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681396352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201608.832643:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681394688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201608.832655:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875064681395712:0@lo:400:kworker.0 00010000:00080000:2.0:1788201608.832666:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce0b6c8bb80 x1875064681396224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201608.832676:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875064681396224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201608.945972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201608.946788:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411136 00000100:00100000:2.0:1788201608.946803:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411136 00000100:00100000:2.0:1788201608.946886:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:2.0:1788201608.946898:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce08895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+10:18198:x1875064662411136:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788201608.946920:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201608.946942:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855ba600/0xf9b71aee44722178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc62a expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.946976:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855ba600/0xf9b71aee44722178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc62a expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.946988:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855ba600/0xf9b71aee44722178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc62a expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.947012:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba600, rc 0) 00000100:00100000:2.0:1788201608.947084:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce08895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+11:18198:x1875064662411136:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 189us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.947092:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:3.0:1788201608.952321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201608.953330:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411264 00000100:00100000:1.0:1788201608.953345:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411264 00000100:00100000:1.0:1788201608.953430:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1788201608.953442:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+11:18198:x1875064662411264:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201608.953684:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+11:18198:x1875064662411264:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 243us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201608.953693:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:3.0:1788201608.962427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201608.962615:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411392 00000100:00100000:2.0:1788201608.962635:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411392 00000100:00100000:2.0:1788201608.962710:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:2.0:1788201608.962722:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+11:18198:x1875064662411392:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788201608.962958:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+11:18198:x1875064662411392:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 238us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.962967:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:3.0:1788201608.982238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201608.982958:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411520 00000100:00100000:2.0:1788201608.982973:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411520 00000100:00100000:2.0:1788201608.983103:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:2.0:1788201608.983115:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+11:18205:x1875064662411520:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201608.986016:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+11:18205:x1875064662411520:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 2895us (3783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201608.986029:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:3.0:1788201609.013413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.013529:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411648 00000100:00100000:1.0:1788201609.013542:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411648 00000100:00100000:1.0:1788201609.013635:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:1.0:1788201609.013648:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+11:18205:x1875064662411648:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201609.013909:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+11:18205:x1875064662411648:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 263us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.013918:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:3.0:1788201609.018280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201609.018517:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411776 00000100:00100000:2.0:1788201609.018530:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411776 00000100:00100000:2.0:1788201609.018603:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:2.0:1788201609.018614:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+11:18205:x1875064662411776:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201609.018996:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+11:18205:x1875064662411776:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 382us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201609.019016:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:3.0:1788201609.027769:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201609.028014:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662411904 00000100:00100000:0.0:1788201609.028025:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662411904 00000100:00100000:0.0:1788201609.028094:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:0.0:1788201609.028107:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+11:18198:x1875064662411904:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201609.028131:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201609.028155:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83296600/0xf9b71aee4472217f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc65b expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.028191:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83296600/0xf9b71aee4472217f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc65b expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.028204:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83296600/0xf9b71aee4472217f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc65b expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.028216:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83296600, rc 0) 00000100:00100000:0.0:1788201609.028292:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+12:18198:x1875064662411904:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 188us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201609.028299:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:3.0:1788201609.032547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.032671:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412032 00000100:00100000:1.0:1788201609.032683:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412032 00000100:00100000:1.0:1788201609.032774:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:1.0:1788201609.032785:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+12:18198:x1875064662412032:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788201609.032820:0:22797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788201609.032858:0:22797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201609.032862:0:22797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201609.032866:0:22797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201609.032869:0:22797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788201609.032872:0:22797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788201609.034459:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+12:18198:x1875064662412032:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 1666us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.034484:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:3.0:1788201609.038569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201609.038710:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412160 00000100:00100000:2.0:1788201609.038724:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412160 00000100:00100000:2.0:1788201609.038838:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:2.0:1788201609.038851:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+12:18198:x1875064662412160:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788201609.038874:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201609.038899:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc662 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.038934:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 13 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.038948:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 13 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.038958:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:2.0:1788201609.039030:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+13:18198:x1875064662412160:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 181us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201609.039039:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:3.0:1788201609.041777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.042146:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412288 00000100:00100000:1.0:1788201609.042159:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412288 00000100:00100000:1.0:1788201609.042279:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:1.0:1788201609.042292:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:18198:x1875064662412288:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201609.042534:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:18198:x1875064662412288:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 245us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.042543:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:3.0:1788201609.044946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201609.045040:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412416 00000100:00100000:0.0:1788201609.045052:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412416 00000100:00100000:0.0:1788201609.045116:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:0.0:1788201609.045128:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+13:18198:x1875064662412416:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788201609.045313:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+13:18198:x1875064662412416:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 186us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201609.045321:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:3.0:1788201609.048919:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.049160:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412544 00000100:00100000:1.0:1788201609.049174:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412544 00000100:00100000:1.0:1788201609.049249:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:1.0:1788201609.049261:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:18209:x1875064662412544:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201609.049462:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:18209:x1875064662412544:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 202us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.049471:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:2.0:1788201609.052061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.052163:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412672 00000100:00100000:1.0:1788201609.052175:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412672 00000100:00100000:1.0:1788201609.052277:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:1.0:1788201609.052290:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+13:18209:x1875064662412672:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201609.052492:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+13:18209:x1875064662412672:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 203us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.052501:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:3.0:1788201609.056415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201609.056525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.056901:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412800 00000100:00100000:1.0:1788201609.056913:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412800 00000100:00100000:1.0:1788201609.056981:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413056 00000100:00100000:1.0:1788201609.056985:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413056 00000100:00100000:1.0:1788201609.057016:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:1.0:1788201609.057026:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875064662412800:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788201609.057065:0:22804:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 9c996026-e1e6-4ca6-95c7-019447b48375@192.168.203.2@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:1.0:1788201609.057112:0:22804:0:(genops.c:1406:class_connect()) connect: client 9c996026-e1e6-4ca6-95c7-019447b48375, cookie 0xf9b71aee4472218d 00000004:00100000:1.0:1788201609.057147:0:22804:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788201609.057271:0:22804:0:(import.c:65:import_set_state_nolock()) ffff9cdf822d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201609.057363:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c996026-e1e6-4ca6-95c7-019447b48375+6:2397:x1875064662412800:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 337us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.057372:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:1.0:1788201609.057391:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1788201609.057396:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875064662413056:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788201609.057414:0:22804:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 9c996026-e1e6-4ca6-95c7-019447b48375@192.168.203.2@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:1.0:1788201609.057438:0:22804:0:(genops.c:1406:class_connect()) connect: client 9c996026-e1e6-4ca6-95c7-019447b48375, cookie 0xf9b71aee44722194 00000004:00100000:1.0:1788201609.057452:0:22804:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788201609.057506:0:22804:0:(import.c:65:import_set_state_nolock()) ffff9cdf822d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201609.057533:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c996026-e1e6-4ca6-95c7-019447b48375+6:2397:x1875064662413056:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 135us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.057539:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1788201609.061235:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201609.061357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.061514:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413184 00000100:00100000:1.0:1788201609.061527:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413184 00000100:00100000:1.0:1788201609.061724:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662412928 00000100:00100000:1.0:1788201609.061728:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662412928 00000100:00080000:2.0:1788201609.061871:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201609.061877:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201609.062023:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201609.062039:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+6:0:x1875064662413184:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201609.062083:0:22805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788201609.062214:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+6:0:x1875064662413184:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 180us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201609.062222:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201609.062242:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201609.062249:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+6:0:x1875064662412928:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201609.062264:0:22805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788201609.062296:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+6:0:x1875064662412928:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 48us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201609.062301:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201609.066883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201609.067096:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413312 00000100:00100000:3.0:1788201609.067109:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413312 00000100:00100000:3.0:1788201609.067177:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:3.0:1788201609.067189:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413312:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788201609.067233:0:22802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788201609.067319:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413312:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 132us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201609.067327:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1788201609.070217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201609.070330:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413440 00000100:00100000:0.0:1788201609.070341:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413440 00000100:00100000:0.0:1788201609.070447:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1788201609.070460:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413440:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788201609.070803:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413440:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 344us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201609.070811:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1788201609.077925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.078041:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413824 00000100:00100000:1.0:1788201609.078054:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413824 00000100:00100000:1.0:1788201609.078126:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1788201609.078156:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413824:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788201609.078268:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413824:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.078276:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1788201609.080614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201609.080715:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201609.080843:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413568 00000100:00100000:3.0:1788201609.080854:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413568 00000100:00100000:3.0:1788201609.080905:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413696 00000100:00100000:3.0:1788201609.080909:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413696 00000100:00100000:3.0:1788201609.080937:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201609.080967:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875064662413568:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788201609.081010:0:24846:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 9c996026-e1e6-4ca6-95c7-019447b48375@192.168.203.2@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1788201609.081049:0:24846:0:(genops.c:1406:class_connect()) connect: client 9c996026-e1e6-4ca6-95c7-019447b48375, cookie 0xf9b71aee4472219b 00002000:00100000:3.0:1788201609.081063:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c996026-e1e6-4ca6-95c7-019447b48375/ffff9ce09d401000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201609.081077:0:24846:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201609.081157:0:24846:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201609.081198:0:24846:0:(import.c:65:import_set_state_nolock()) ffff9ce0b21aa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201609.081277:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c996026-e1e6-4ca6-95c7-019447b48375+6:2397:x1875064662413568:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 311us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201609.081285:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201609.081302:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201609.081306:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875064662413696:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788201609.081323:0:24846:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 9c996026-e1e6-4ca6-95c7-019447b48375@192.168.203.2@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1788201609.081342:0:24846:0:(genops.c:1406:class_connect()) connect: client 9c996026-e1e6-4ca6-95c7-019447b48375, cookie 0xf9b71aee447221a2 00002000:00100000:3.0:1788201609.081348:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c996026-e1e6-4ca6-95c7-019447b48375/ffff9ce09d614000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201609.081355:0:24846:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201609.081404:0:24846:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201609.081439:0:24846:0:(import.c:65:import_set_state_nolock()) ffff9ce0bc648000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201609.081466:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c996026-e1e6-4ca6-95c7-019447b48375+6:2397:x1875064662413696:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 157us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201609.081473:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201609.083893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201609.084068:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662413952 00000100:00100000:1.0:1788201609.084081:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662413952 00000100:00100000:1.0:1788201609.084142:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:1.0:1788201609.084154:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413952:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788201609.084269:0:22807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788201609.084376:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c996026-e1e6-4ca6-95c7-019447b48375+6:18198:x1875064662413952:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 223us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.084384:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000001:00100000:2.0:1788201609.088313:0:25132:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c996026-e1e6-4ca6-95c7-019447b48375 00000001:00100000:2.0:1788201609.088331:0:25132:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a02e8f03-e864-49bb-8879-8d6d5f03b6c1 00000001:00080000:2.0:1788201609.088359:0:25132:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000040:00080000:0.0:1788201609.142551:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788201609.233600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201609.233939:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414080 00000100:00100000:3.0:1788201609.233952:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414080 00000100:00100000:3.0:1788201609.234048:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201609.234060:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+6:18232:x1875064662414080:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:3.0:1788201609.234087:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201609.234123:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee447221a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc693 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201609.234373:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201609.234390:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201609.234408:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201609.234471:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201609.234475:0:22802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201609.234498:0:22802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201609.234527:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee447221a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 8 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201609.234549:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 7 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201609.234559:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:3.0:1788201609.234563:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201609.234566:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1400, rc 0) 00000100:00100000:3.0:1788201609.234707:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+7:18232:x1875064662414080:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 648us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201609.234721:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00010000:00010000:0.0:1788201609.527135:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201610.553221:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201611.381967:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201611.381991:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681396480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201611.382055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.382153:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396480 00000100:00100000:0.0:1788201611.382160:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396480 00000100:00100000:0.0:1788201611.382225:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201611.382235:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681396480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201611.382263:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788201611.382312:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681396480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.382319:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201611.382369:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681396480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201611.382496:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201611.580067:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201611.813364:0:25687:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:0.0:1788201612.278866:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788201612.411056:0:23536:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9c996026-e1e6-4ca6-95c7-019447b48375 00000001:00100000:2.0:1788201612.411067:0:23536:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a02e8f03-e864-49bb-8879-8d6d5f03b6c1 00000001:00100000:1.0:1788201612.411211:0:22783:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c996026-e1e6-4ca6-95c7-019447b48375 00000001:00100000:1.0:1788201612.411219:0:22783:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a02e8f03-e864-49bb-8879-8d6d5f03b6c1 00000001:00100000:0.0:1788201612.411357:0:24308:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c996026-e1e6-4ca6-95c7-019447b48375 00000001:00100000:0.0:1788201612.411363:0:24308:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a02e8f03-e864-49bb-8879-8d6d5f03b6c1 00010000:00010000:0.0:1788201612.598049:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201613.430871:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201613.430903:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681396608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201613.431002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201613.431076:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681396736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201613.431115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201613.431155:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396608 00000100:00100000:1.0:1788201613.431163:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396608 00000100:00100000:1.0:1788201613.431226:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201613.431237:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681396608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201613.431278:0:22809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788201613.431344:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681396608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201613.431352:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201613.431402:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681396608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201613.431482:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396736 00000100:00100000:1.0:1788201613.431486:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396736 00000100:00100000:1.0:1788201613.431526:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201613.431533:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681396736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201613.431568:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201613.431605:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681396736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201613.431612:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788201613.431629:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201613.431652:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681396736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201613.432041:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681396864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201613.432634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201613.436659:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396864 00000100:00100000:1.0:1788201613.436679:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396864 00000100:00100000:1.0:1788201613.437247:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201613.437263:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681396864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201613.437316:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788201613.437426:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681396864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (4794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201613.437434:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201613.437524:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681396864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788201613.621863:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201613.941933:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681396992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201613.942033:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942046:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681397376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942088:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942113:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681397888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942155:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681398400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201613.942169:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681397504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201613.942206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942212:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788201613.942219:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942275:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681397760:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942312:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681398272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942367:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681397376 00000100:00100000:3.0:1788201613.942376:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681397376 00000100:00100000:3.0:1788201613.942438:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681397888 00000100:00100000:3.0:1788201613.942441:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681397888 00000100:00100000:3.0:1788201613.942474:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201613.942484:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681397376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942546:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681397376:12345-0@lo:400:kworker.0 Request processed in 64us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.942554:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201613.942571:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201613.942579:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681397888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942605:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681397888:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.942612:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201613.942635:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681398400 00000100:00100000:3.0:1788201613.942639:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681398400 00000100:00100000:3.0:1788201613.942667:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681398272 00000100:00100000:3.0:1788201613.942670:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681398272 00000100:00100000:3.0:1788201613.942689:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201613.942695:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681398400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942725:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875064681398400:12345-0@lo:400:kworker.0 Request processed in 31us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.942732:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201613.942806:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201613.942814:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681398272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201613.942848:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681398016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942855:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875064681398272:12345-0@lo:400:kworker.0 Request processed in 41us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.942862:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201613.942883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942885:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681397248 00000100:00100000:3.0:1788201613.942890:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681397248 00000100:00100000:1.0:1788201613.942908:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681398528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.942920:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681397760 00000100:00100000:3.0:1788201613.942931:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681397760 00000100:00100000:1.0:1788201613.942942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.942953:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201613.942962:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681397248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201613.942965:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788201613.942974:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681397120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943006:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681397248:12345-0@lo:400:kworker.0 Request processed in 46us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.943013:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201613.943018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.943029:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201613.943038:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681397760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201613.943048:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681397632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943079:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875064681397760:12345-0@lo:400:kworker.0 Request processed in 42us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.943086:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201613.943109:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681398528 00000100:00100000:3.0:1788201613.943113:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681398528 00000100:00100000:3.0:1788201613.943131:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201613.943137:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681398528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943168:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875064681398528:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.943173:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788201613.943190:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201613.943195:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201613.943198:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201613.943209:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681397504 00000100:00100000:3.0:1788201613.943212:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681397504 00000100:00100000:3.0:1788201613.943235:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681398016 00000100:00100000:3.0:1788201613.943237:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681398016 00000100:00100000:3.0:1788201613.943250:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201613.943255:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681397504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943290:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875064681397504:12345-0@lo:400:kworker.0 Request processed in 34us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.943303:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201613.943313:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201613.943320:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681398016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943350:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681398016:12345-0@lo:400:kworker.0 Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.943355:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788201613.943378:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201613.943417:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943429:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681397760:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943440:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875064681398272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943451:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681397376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943461:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875064681397888:0@lo:400:kworker.0 00010000:00080000:3.0:1788201613.943475:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf82396d80 x1875064681398400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201613.943486:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875064681398400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.943557:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681396992 00000100:00100000:3.0:1788201613.943562:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681396992 00000100:00100000:3.0:1788201613.943588:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201613.943595:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681396992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201613.943622:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788201613.943660:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681396992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.943667:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201613.943829:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201613.943951:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681397120 00000100:00100000:0.0:1788201613.943957:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681397120 00000100:00100000:0.0:1788201613.943994:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201613.944002:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3644:x1875064681397120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201613.944041:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3644:x1875064681397120:12345-0@lo:400:kworker.0 Request processed in 41us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201613.944046:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788201613.944140:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681397632 00000100:00100000:3.0:1788201613.944145:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681397632 00000100:00100000:3.0:1788201613.944215:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201613.944222:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681397632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.944255:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875064681397632:12345-0@lo:400:kworker.0 Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.944261:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201613.945186:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875064681397632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.945203:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681398144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.945252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.945327:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681398656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.945354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201613.945435:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201613.945450:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681398784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201613.945489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.945526:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788201613.945530:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681398784 00000100:00100000:1.0:1788201613.945538:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681398784 00000100:00100000:3.0:1788201613.945548:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875064681397504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.945564:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681398016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201613.945586:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201613.945596:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681398784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201613.945619:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788201613.945660:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875064681398784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201613.945667:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201613.945719:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875064681398784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201613.945734:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875064681398528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.945781:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0b6c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681396992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201613.945837:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681397120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.945926:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681398144 00000100:00100000:2.0:1788201613.945932:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681398144 00000100:00100000:2.0:1788201613.945968:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681398656 00000100:00100000:2.0:1788201613.945971:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681398656 00000100:00100000:2.0:1788201613.945997:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201613.946004:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681398144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.946046:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875064681398144:12345-0@lo:400:kworker.0 Request processed in 43us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201613.946052:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201613.946065:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201613.946084:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681398656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.946114:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875064681398656:12345-0@lo:400:kworker.0 Request processed in 43us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201613.946119:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788201613.946171:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201613.946199:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875064681398144:0@lo:400:kworker.0 00010000:00080000:3.0:1788201613.946212:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf837e7480 x1875064681398656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201613.946222:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875064681398656:0@lo:400:kworker.0 00000100:00100000:2.0:1788201614.535101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201614.535421:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414336 00000100:00100000:2.0:1788201614.535432:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414336 00000100:00100000:2.0:1788201614.535515:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414848 00000100:00100000:2.0:1788201614.535519:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414848 00000100:00100000:2.0:1788201614.535535:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414464 00000100:00100000:2.0:1788201614.535538:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414464 00000100:00100000:2.0:1788201614.535552:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414976 00000100:00100000:2.0:1788201614.535555:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414976 00000100:00100000:2.0:1788201614.535574:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1788201614.535585:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2400:x1875064662414336:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201614.535680:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2400:x1875064662414336:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 96us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201614.535688:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1788201614.535708:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:2.0:1788201614.535715:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+6:2400:x1875064662414848:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201614.535770:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+6:2400:x1875064662414848:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 55us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201614.535778:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:2.0:1788201614.535802:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:2.0:1788201614.535811:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662414464:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201614.535838:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662414464:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201614.535845:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:2.0:1788201614.535857:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:2.0:1788201614.536111:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662414976:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201614.536151:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662414976:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 45us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201614.536213:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414592 00000100:00100000:1.0:1788201614.536218:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414592 00000100:00100000:1.0:1788201614.536247:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662415104 00000100:00100000:1.0:1788201614.536250:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662415104 00000100:00100000:1.0:1788201614.536264:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414720 00000100:00100000:1.0:1788201614.536267:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414720 00000100:00100000:1.0:1788201614.536292:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662415232 00000100:00100000:1.0:1788201614.536295:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662415232 00000100:00100000:1.0:1788201614.536310:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:1.0:1788201614.536317:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662414592:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201614.536345:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662414592:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201614.536351:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:1.0:1788201614.536375:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:1.0:1788201614.536381:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662415104:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201614.536403:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662415104:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201614.536420:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:1.0:1788201614.536440:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:1.0:1788201614.536446:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662414720:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201614.536482:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662414720:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201614.536489:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:1.0:1788201614.536503:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1788201614.536511:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662415232:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201614.536535:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662415232:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201614.536542:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1788201614.537255:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662414208 00000100:00100000:1.0:1788201614.537264:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662414208 00000100:00100000:1.0:1788201614.537333:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:1.0:1788201614.537344:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+13:2400:x1875064662414208:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1788201614.537384:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+13:2400:x1875064662414208:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201614.537391:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:2.0:1788201614.538045:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00080000:2.0:1788201614.538075:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201614.538082:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201614.538086:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201614.538089:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201614.646535:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201615.672968:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201615.716440:0:25835:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda179e420 20000000:00000080:1.0:1788201615.716463:0:25835:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce0aba43c00 uarg=0000000000000000 20000000:01000000:1.0:1788201615.716516:0:25835:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788201615.716522:0:25835:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788201615.716529:0:25835:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788201615.717303:0:25836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788201615.717543:0:25835:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788201615.722973:0:25835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788201615.723110:0:25835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723134:0:25835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 23 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723142:0:25835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 23 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723150:0:25835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 23 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723156:0:25835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723165:0:25835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723173:0:25835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723181:0:25835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723253:0:25835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.723269:0:25835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 12 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.723287:0:25835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681398912:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201615.724583:0:25835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.724601:0:25835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 12 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.724615:0:25835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399040:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201615.724825:0:25835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.724834:0:25835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 23 pid: 22796 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.724845:0:25835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399168:0@lo:104: 00000100:00100000:2.0:1788201615.724898:0:25835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201615.725010:0:25835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 23 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.725019:0:25835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 23 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.725049:0:25835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399296:0@lo:104: 00000100:00100000:2.0:1788201615.725073:0:25835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201615.728018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201615.728059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201615.728153:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662415360 00000100:00100000:1.0:1788201615.728164:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662415360 00010000:00010000:1.0:1788201615.728210:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 13 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201615.728252:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662415488 00000100:00100000:1.0:1788201615.728256:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662415488 00010000:00010000:1.0:1788201615.728279:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 14 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201615.728303:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1788201615.728313:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:faacd08d-6bc4-48af-a10c-977150f7f541+14:2399:x1875064662415360:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201615.728332:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201615.728339:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 14 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201615.728352:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 14 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201615.728398:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201615.728461:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:faacd08d-6bc4-48af-a10c-977150f7f541+14:2399:x1875064662415360:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 148us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201615.728469:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1788201615.728497:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:1.0:1788201615.728504:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:faacd08d-6bc4-48af-a10c-977150f7f541+13:2399:x1875064662415488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201615.728514:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201615.728518:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 13 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201615.728528:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 13 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201615.728538:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201615.728555:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:faacd08d-6bc4-48af-a10c-977150f7f541+13:2399:x1875064662415488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 52us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201615.728561:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:0.0:1788201615.729974:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681399168 00000100:00100000:0.0:1788201615.729992:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681399168 00000100:00100000:0.0:1788201615.730043:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681399296 00000100:00100000:0.0:1788201615.730048:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681399296 00000100:00100000:0.0:1788201615.730068:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201615.730079:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:25835:x1875064681399168:12345-0@lo:104: 00010000:00010000:0.0:1788201615.730184:0:22787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.730287:0:22787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201615.730295:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+4:25835:x1875064681399168:12345-0@lo:104: Request processed in 218us (5397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201615.730302:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201615.730320:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201615.730328:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:25835:x1875064681399296:12345-0@lo:104: 00010000:00010000:0.0:1788201615.730336:0:22787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730362:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201615.730372:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.730380:0:22787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788201615.730383:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1519c20) 00000100:00100000:0.0:1788201615.730388:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:25835:x1875064681399296:12345-0@lo:104: Request processed in 61us (5312us total) trans 0 rc 0/0 10000000:00010000:3.0:1788201615.730390:0:22792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201615.730402:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788201615.730407:0:22792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201615.730415:0:22792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201615.730422:0:22792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201615.730463:0:22792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730470:0:22792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201615.730501:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730509:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83254c00/0xf9b71aee44721fdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721fe2 expref: -99 pid: 25131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730539:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201615.730542:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201615.730544:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730560:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03af000 already unused, calling callback (ffffffffc1519c20) 00000100:00100000:0.0:1788201615.730561:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:3.0:1788201615.730564:0:22792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201615.730580:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681399424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201615.730586:0:22792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201615.730595:0:22792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201615.730600:0:22792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201615.730622:0:22792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730629:0:22792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201615.730634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201615.730661:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730668:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9ce0a03af000/0xf9b71aee44721e5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e61 expref: -99 pid: 24307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.730680:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201615.730681:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201615.730683:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201615.730695:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681399552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201615.731143:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681399424 00000100:00100000:0.0:1788201615.731150:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681399424 00010000:00010000:0.0:1788201615.731177:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 24 pid: 22796 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201615.731204:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201615.731211:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3646:x1875064681399424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201615.731224:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201615.731237:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 24 pid: 22796 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.731250:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 24 pid: 22796 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.731271:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201615.732074:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201615.732096:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3646:x1875064681399424:12345-0@lo:103:ldlm_bl.0 Request processed in 882us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201615.732108:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201615.732130:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681399552 00000100:00100000:0.0:1788201615.732135:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681399552 00010000:00010000:0.0:1788201615.732163:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 24 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.732174:0:25835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 24 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.732190:0:25835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 24 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201615.732196:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201615.732206:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681399424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201615.732210:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3644:x1875064681399552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201615.732222:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201615.732228:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 24 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.732240:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 24 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.732255:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201615.732269:0:25835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399680:0@lo:104: 00000100:00100000:2.0:1788201615.732306:0:25835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201615.732388:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3644:x1875064681399552:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201615.732397:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201615.732400:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3644:1875064681399552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201615.738302:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681399680 00000100:00100000:3.0:1788201615.738323:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681399680 00000100:00100000:3.0:1788201615.738469:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201615.738505:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:25835:x1875064681399680:12345-0@lo:104: 00010000:00010000:2.0:1788201615.738831:0:25835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 23 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.738849:0:25835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 23 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.738865:0:25835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399808:0@lo:104: 00000100:00100000:2.0:1788201615.739062:0:25835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201615.739108:0:22787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.739181:0:22787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201615.739189:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:25835:x1875064681399680:12345-0@lo:104: Request processed in 690us (6881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201615.739198:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788201615.739263:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201615.739273:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.739291:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255000 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201615.739295:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.739304:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201615.739311:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201615.739317:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201615.739354:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.739362:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201615.739392:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.739401:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255000/0xf9b71aee44721e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e22 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.739417:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201615.739419:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201615.739421:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201615.739446:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681399936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201615.739486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201615.739554:0:23959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681399936 00000100:00100000:0.0:1788201615.739560:0:23959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681399936 00010000:00010000:0.0:1788201615.739597:0:23959:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 24 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201615.739642:0:23959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201615.739652:0:23959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3645:x1875064681399936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201615.739665:0:23959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201615.739672:0:23959:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 24 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.739683:0:23959:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 24 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.739704:0:23959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201615.739754:0:23959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3645:x1875064681399936:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201615.739762:0:23959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201615.739848:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681399936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201615.740406:0:25835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788201615.740431:0:25835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bba00/0xf9b71aee44722186 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc662 expref: 12 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.740446:0:25835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681398912:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201615.740459:0:25835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bb000/0xf9b71aee44722147 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc5f2 expref: 11 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.740468:0:25835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399040:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201615.740496:0:25835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74e00/0xf9b71aee44721fe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721fdb expref: 23 pid: 22796 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.740508:0:25835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399168:0@lo:104: 00010000:00010000:2.0:1788201615.740887:0:25835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce098a74800/0xf9b71aee44721e61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721e5a expref: 22 pid: 22798 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.740897:0:25835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399296:0@lo:104: 00010000:00010000:2.0:1788201615.740907:0:25835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03ae600/0xf9b71aee44721e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721e1b expref: 21 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.740916:0:25835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399680:0@lo:104: 00000100:00100000:3.0:1788201615.740993:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681399808 00000100:00100000:3.0:1788201615.741000:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681399808 00000100:00100000:3.0:1788201615.741034:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201615.741043:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:25835:x1875064681399808:12345-0@lo:104: 00010000:00010000:3.0:1788201615.741059:0:22787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201615.741146:0:22787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201615.741152:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+3:25835:x1875064681399808:12345-0@lo:104: Request processed in 111us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201615.741158:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788201615.741214:0:22792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201615.741221:0:22792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741230:0:22792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1519c20) 10000000:00010000:0.0:1788201615.741233:0:22792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741242:0:22792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201615.741250:0:22792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201615.741269:0:22792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201615.741313:0:22792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741320:0:22792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201615.741345:0:22792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741352:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9cdf83255400/0xf9b71aee44721e0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf9b71aee44721e14 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741371:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201615.741373:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201615.741375:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201615.741390:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681400064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201615.741431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201615.741471:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681400064 00000100:00100000:0.0:1788201615.741475:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681400064 00010000:00010000:0.0:1788201615.741493:0:22790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 21 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201615.741528:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201615.741536:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3646:x1875064681400064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201615.741548:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201615.741553:0:22790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 21 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741564:0:22790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 21 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741602:0:22790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741612:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741638:0:22790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741647:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741655:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741663:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741669:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201615.741674:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741682:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741692:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201615.741702:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201615.741731:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:3646:x1875064681400064:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201615.741773:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201615.741818:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3646:1875064681400064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201615.742182:0:25835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0a03af600/0xf9b71aee44721e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf9b71aee44721e0d expref: 20 pid: 22797 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.742195:0:25835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25835:1875064681399808:0@lo:104: 00010000:00010000:2.0:1788201615.742226:0:25835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.742236:0:25835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.742242:0:25835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201615.742248:0:25835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce0855bb400/0xf9b71aee447221b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201616.502055:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201616.506167:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681400192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201616.506275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.506597:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681400192 00000100:00100000:1.0:1788201616.506610:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681400192 00000100:00100000:1.0:1788201616.506766:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201616.506788:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681400192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201616.506830:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201616.506905:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681400192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201616.506929:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201616.507311:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681400192:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201616.507434:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201616.697985:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201617.123000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.123721:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662415616 00000100:00100000:2.0:1788201617.123777:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662415616 00000100:00100000:2.0:1788201617.123883:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1788201617.123898:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:18700:x1875064662415616:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201617.123928:0:24337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201617.123960:0:24337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee447221be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc69a expref: -99 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124048:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124065:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124081:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124098:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124104:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124111:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124218:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447221d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124248:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447221d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124263:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447221d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201617.124313:0:24337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201617.124318:0:24337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201617.124362:0:24337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447221d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124374:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124381:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124389:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124397:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.124402:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124411:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124424:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:2.0:1788201617.124428:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.124434:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124452:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb000/0xf9b71aee447221c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124470:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124476:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124481:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124486:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.124489:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124494:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124502:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ce08b1ee900) 00010000:00010000:2.0:1788201617.124504:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.124507:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124512:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee447221cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.124553:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee447221be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc69a expref: 8 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201617.124700:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201617.125987:0:24337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb200/0xf9b71aee447221d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc69a expref: 7 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.125999:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce08b1ee000) 00010000:00010000:2.0:1788201617.126002:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201617.126006:0:24337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb200, rc 0) 00000100:00100000:2.0:1788201617.126108:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18700:x1875064662415616:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2214us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.126119:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1788201617.147611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.150414:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662415744 00000100:00100000:2.0:1788201617.150438:0:22814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662415744 00000100:00100000:2.0:1788201617.150525:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1788201617.150537:0:22814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18700:x1875064662415744:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788201617.150917:0:22814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18700:x1875064662415744:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 Request processed in 381us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.150927:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:3.0:1788201617.154155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.154276:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662416000 00000100:00100000:0.0:1788201617.154300:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662416000 00000100:00100000:0.0:1788201617.154379:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1788201617.154392:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18700:x1875064662416000:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788201617.154421:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201617.154449:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee447221da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6a1 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154558:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154599:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154614:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154634:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154642:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154650:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154890:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296a00/0xf9b71aee447221ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154900:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296a00/0xf9b71aee447221ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.154907:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296a00/0xf9b71aee447221ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201617.154918:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788201617.155126:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155134:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155143:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155150:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83297400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201617.155155:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155163:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155177:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce08b1ee000) 00010000:00010000:0.0:1788201617.155181:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201617.155187:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155204:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee447221e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155222:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155229:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155234:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155239:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83296800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201617.155241:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155247:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155255:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ce09d9f6e00) 00010000:00010000:0.0:1788201617.155257:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201617.155260:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.155266:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee447221e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.156891:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee447221da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6a1 expref: 10 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.156946:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296a00/0xf9b71aee447221ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6a1 expref: 9 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.156956:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce09d9f6600) 00010000:00010000:0.0:1788201617.156959:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201617.156963:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83296a00, rc 0) 00000100:00100000:0.0:1788201617.157183:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18700:x1875064662416000:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2792us (3041us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788201617.157194:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:3.0:1788201617.167444:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201617.167923:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662416128 00000100:00100000:1.0:1788201617.167938:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662416128 00000100:00100000:1.0:1788201617.168079:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1788201617.168093:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18700:x1875064662416128:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788201617.168256:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18700:x1875064662416128:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 166us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201617.168265:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:3.0:1788201617.171340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.176200:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662416256 00000100:00100000:2.0:1788201617.176230:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662416256 00000100:00100000:2.0:1788201617.176357:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:2.0:1788201617.176375:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:18700:x1875064662416256:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788201617.178571:0:24337:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2136us 00000100:00080000:3.0:1788201617.178805:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201617.210032:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:18700:x1875064662416256:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 33646us (38688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.210052:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:2.0:1788201617.218181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201617.218265:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662416384 00000100:00100000:1.0:1788201617.218275:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662416384 00000100:00100000:1.0:1788201617.218337:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1788201617.218346:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18706:x1875064662416384:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1788201617.218367:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201617.218387:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee447221fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6a8 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218444:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218457:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218468:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218482:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218503:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218510:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218550:0:22805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218557:0:22805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218564:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218570:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83254c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201617.218574:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218581:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218592:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:1.0:1788201617.218595:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201617.218598:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218605:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254c00/0xf9b71aee44722204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218616:0:22805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218627:0:22805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218633:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218637:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201617.218640:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218646:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218652:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce089cc2c00) 00010000:00010000:1.0:1788201617.218655:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201617.218657:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218662:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee4472220b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218689:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee447221fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6a8 expref: 10 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218699:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:1.0:1788201617.218701:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201617.218705:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83254a00/0xf9b71aee447221fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6a8 expref: 10 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.218724:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254a00, rc 0) 00000100:00100000:1.0:1788201617.218811:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18706:x1875064662416384:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 466us (637us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201617.218818:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1788201617.229836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.230343:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662416512 00000100:00100000:0.0:1788201617.230353:0:22812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662416512 00000100:00100000:0.0:1788201617.230411:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1788201617.230422:0:22812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18706:x1875064662416512:12345-192.168.203.2@tcp:700:lfs.0 00000100:00100000:0.0:1788201617.230512:0:22812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18706:x1875064662416512:12345-192.168.203.2@tcp:700:lfs.0 Request processed in 91us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.230521:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1788201617.231851:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.233289:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662416768 00000100:00100000:2.0:1788201617.233302:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662416768 00000100:00100000:2.0:1788201617.233367:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:2.0:1788201617.233378:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:18706:x1875064662416768:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:2.0:1788201617.233437:0:22802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201617.233464:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297600/0xf9b71aee44722171 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc623 expref: 9 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.233485:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:2.0:1788201617.233490:0:22802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201617.233550:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.233564:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 5 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.233574:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.233610:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 5 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.233623:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 5 pid: 22802 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201617.233639:0:22802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22802:1875064681400320:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201617.234037:0:22802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201617.236359:0:22802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22802:1875064681400320:192.168.203.2@tcp:104: 00010000:00010000:3.0:1788201617.236388:0:22802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.237685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.237799:0:23959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662416896 00000100:00100000:0.0:1788201617.237806:0:23959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662416896 00010000:00010000:0.0:1788201617.237854:0:23959:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 6 pid: 22802 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.237885:0:23959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:0.0:1788201617.237895:0:23959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c996026-e1e6-4ca6-95c7-019447b48375+6:2398:x1875064662416896:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1788201617.237907:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201617.237909:0:23959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201617.237916:0:23959:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 6 pid: 22802 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.237938:0:23959:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 6 pid: 22802 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.237959:0:23959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee447221b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc693 expref: 6 pid: 22802 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.237975:0:23959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:0.0:1788201617.237981:0:23959:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.237989:0:23959:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.237996:0:23959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.238025:0:23959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201617.238083:0:23959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c996026-e1e6-4ca6-95c7-019447b48375+5:2398:x1875064662416896:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 189us (402us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201617.238085:0:22802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.238090:0:23959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00010000:00010000:3.0:1788201617.238092:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.238114:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.238124:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.238133:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239391:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239406:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239414:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201617.239428:0:22802:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093761567 reply state 000000006a2379a8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239437:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239443:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:2.0:1788201617.239446:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201617.239448:0:22802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788201617.239453:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788201617.239459:0:22802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239464:0:22802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239470:0:22802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239476:0:22802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.239479:0:22802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239485:0:22802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239500:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6400) 00010000:00010000:2.0:1788201617.239502:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.239505:0:22802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239511:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722212 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201617.239529:0:22802:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093761567 reply state 000000006a2379a8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239538:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.239544:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce086386800) 00010000:00010000:2.0:1788201617.239546:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201617.239548:0:22802:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788201617.239629:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+10:18706:x1875064662416768:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 6252us (7780us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788201617.239637:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:3.0:1788201617.333495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000040:00080000:0.0:1788201617.335305:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788201617.337324:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662417024 00000100:00100000:1.0:1788201617.337338:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662417024 00000100:00100000:0.0:1788201617.337962:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:0.0:1788201617.337974:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+10:18714:x1875064662417024:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:0.0:1788201617.337999:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201617.338031:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee44722227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6af expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.338114:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee4472222e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.338128:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee4472222e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.338138:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee4472222e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201617.338187:0:22805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201617.338191:0:22805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201617.338224:0:22805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee4472222e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.338247:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee44722227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6af expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.338265:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83296800/0xf9b71aee4472222e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6af expref: 11 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.338274:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:0.0:1788201617.338277:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201617.338280:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83296800, rc 0) 00000100:00100000:0.0:1788201617.338347:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+11:18714:x1875064662417024:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 375us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.338354:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:3.0:1788201617.369867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.370362:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662417152 00000100:00100000:0.0:1788201617.370372:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662417152 00000100:00100000:0.0:1788201617.370453:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:0.0:1788201617.370464:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c996026-e1e6-4ca6-95c7-019447b48375+5:18715:x1875064662417152:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201617.370484:0:24337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201617.370504:0:24337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee44722235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6b6 expref: -99 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.370578:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee4472223c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.370592:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee4472223c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.370602:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee4472223c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201617.370814:0:24337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201617.370819:0:24337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201617.370845:0:24337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee4472223c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.370871:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee44722235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6b6 expref: 7 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.370888:0:24337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297400/0xf9b71aee4472223c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6b6 expref: 6 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.370897:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:0.0:1788201617.370900:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201617.370903:0:24337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83297400, rc 0) 00000100:00100000:0.0:1788201617.370967:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c996026-e1e6-4ca6-95c7-019447b48375+6:18715:x1875064662417152:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 505us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.370980:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:1.0:1788201617.375650:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.375837:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662417280 00000100:00100000:2.0:1788201617.375847:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662417280 00000100:00100000:2.0:1788201617.375906:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:2.0:1788201617.375917:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c996026-e1e6-4ca6-95c7-019447b48375+6:18715:x1875064662417280:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1788201617.375938:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201617.375957:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6bd expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376017:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376042:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376053:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376065:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376072:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376079:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376145:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44722258 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376153:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44722258 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376160:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44722258 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201617.376197:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201617.376201:0:22804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201617.376220:0:22804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44722258 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376231:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376248:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376254:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376261:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.376264:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376282:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376294:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:2.0:1788201617.376297:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.376301:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376308:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee4472224a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376323:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376329:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376336:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376341:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bae00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.376351:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376358:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376365:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce086386800) 00010000:00010000:2.0:1788201617.376367:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.376370:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376376:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bae00/0xf9b71aee44722251 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376401:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6bd expref: 8 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376415:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44722258 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6bd expref: 7 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.376422:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:2.0:1788201617.376425:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201617.376427:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba200, rc 0) 00000100:00100000:2.0:1788201617.376480:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c996026-e1e6-4ca6-95c7-019447b48375+7:18715:x1875064662417280:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 565us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.376487:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:3.0:1788201617.383901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.384041:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662417408 00000100:00100000:0.0:1788201617.384051:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662417408 00000100:00100000:0.0:1788201617.384119:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1788201617.384130:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c996026-e1e6-4ca6-95c7-019447b48375+5:18715:x1875064662417408:12345-192.168.203.2@tcp:900:lfs.0 00000100:00100000:0.0:1788201617.384216:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c996026-e1e6-4ca6-95c7-019447b48375+5:18715:x1875064662417408:12345-192.168.203.2@tcp:900:lfs.0 Request processed in 88us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.384224:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00080000:3.0:1788201617.385011:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201617.386889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.387035:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662417664 00000100:00100000:0.0:1788201617.387043:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662417664 00000100:00100000:0.0:1788201617.387143:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:0.0:1788201617.387155:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c996026-e1e6-4ca6-95c7-019447b48375+7:18715:x1875064662417664:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1788201617.387174:0:24337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201617.387194:0:24337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee4472225f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6c4 expref: -99 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201617.387294:0:24337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788201617.387389:0:24337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee4472225f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6c4 expref: 9 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.387403:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:0.0:1788201617.387406:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201617.387411:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83297200/0xf9b71aee4472225f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6c4 expref: 9 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.387425:0:24337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83297200, rc 0) 00000100:00100000:0.0:1788201617.387510:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c996026-e1e6-4ca6-95c7-019447b48375+8:18715:x1875064662417664:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 348us (619us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788201617.387518:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:1.0:1788201617.392083:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.392173:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662417920 00000100:00100000:3.0:1788201617.392182:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662417920 00000100:00100000:3.0:1788201617.392236:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:3.0:1788201617.392245:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c996026-e1e6-4ca6-95c7-019447b48375+8:18715:x1875064662417920:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:3.0:1788201617.392295:0:22804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201617.392320:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee44722258 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6bd expref: 8 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.392357:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:3.0:1788201617.392362:0:22804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201617.392382:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.392395:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.392404:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201617.392607:0:22804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099fd40db reply state 0000000077775b15 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.392728:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.392735:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:3.0:1788201617.392815:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788201617.392818:0:22804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788201617.392828:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788201617.393711:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c996026-e1e6-4ca6-95c7-019447b48375+9:18715:x1875064662417920:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 1463us (1633us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788201617.393720:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 10000000:01000000:3.0:1788201617.397932:0:22800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201617.397939:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0ab9c2000 from 13 10000000:01000000:3.0:1788201617.397944:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201617.397987:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee44722274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.398015:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee44722274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.398027:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee44722274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.398051:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.398111:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.398151:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201617.398210:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681400448 00000100:00100000:1.0:1788201617.398216:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681400448 00000100:00100000:1.0:1788201617.398272:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201617.398282:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+20:22800:x1875064681400448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201617.398296:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201617.398311:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255000/0xf9b71aee4472227b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44722274 expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.398333:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255000/0xf9b71aee4472227b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44722274 expref: 21 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.398344:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255000/0xf9b71aee4472227b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44722274 expref: 21 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.398353:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255000, rc 0) 00000100:00100000:1.0:1788201617.398397:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681400448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201617.398404:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201617.398488:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201617.398500:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee44722274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472227b expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.398508:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee44722274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee4472227b expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.398557:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.398581:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.398597:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201617.398652:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681400576 00000100:00100000:2.0:1788201617.398656:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681400576 00000100:00100000:2.0:1788201617.398682:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788201617.398688:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681400576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201617.398827:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681400576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.398833:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201617.398962:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.398987:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.399022:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.399047:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201617.399094:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681400704 00000100:00100000:1.0:1788201617.399098:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681400704 00000100:00100000:1.0:1788201617.399116:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788201617.399122:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681400704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201617.399199:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681400704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201617.399206:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201617.399278:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201617.399997:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201617.401228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201617.401343:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662418176 00000100:00100000:1.0:1788201617.401350:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662418176 00000100:00100000:1.0:1788201617.401396:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:1.0:1788201617.401406:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c996026-e1e6-4ca6-95c7-019447b48375+9:18715:x1875064662418176:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1788201617.402172:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c996026-e1e6-4ca6-95c7-019447b48375+10:18715:x1875064662418176:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 211us (392us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788201617.402183:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000040:00080000:0.0:1788201617.403129:0:25849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788201617.403328:0:22800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788201617.403355:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201617.403364:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee44722274 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472227b expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.403374:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0816a1a00/0xf9b71aee44722274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee4472227b expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201617.403383:0:22800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201617.403386:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cdf8376a000 from 13 10000000:01000000:3.0:1788201617.403389:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201617.403420:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0e00/0xf9b71aee44722282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.403427:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0e00/0xf9b71aee44722282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.403436:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0e00/0xf9b71aee44722282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.403458:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.403510:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.403890:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.404045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.404211:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662418432 00000100:00100000:3.0:1788201617.404218:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662418432 00000100:00100000:3.0:1788201617.404266:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:3.0:1788201617.404275:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+10:18715:x1875064662418432:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201617.404292:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201617.404307:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44722289 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6cb expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404384:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404398:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404409:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404420:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404427:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404434:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201617.404531:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788201617.404857:0:22802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404865:0:22802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404871:0:22802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404878:0:22802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201617.404881:0:22802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404898:0:22802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404909:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:3.0:1788201617.404911:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201617.404916:0:22802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404921:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1c00/0xf9b71aee44722290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404933:0:22802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404938:0:22802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404943:0:22802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404948:0:22802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a1600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201617.404951:0:22802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404956:0:22802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404962:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce086386800) 00010000:00010000:3.0:1788201617.404964:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201617.404967:0:22802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.404980:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1600/0xf9b71aee44722297 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.405011:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44722289 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6cb expref: 12 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.405022:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:3.0:1788201617.405024:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201617.405028:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a1400/0xf9b71aee44722289 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6cb expref: 12 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.405036:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0816a1400, rc 0) 00000100:00100000:3.0:1788201617.405176:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+11:18715:x1875064662418432:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 807us (1037us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788201617.405185:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1788201617.405722:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681400832 00000100:00100000:1.0:1788201617.405729:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681400832 00000100:00100000:1.0:1788201617.405918:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788201617.405927:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+21:22800:x1875064681400832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201617.405938:0:22797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201617.405951:0:22797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254c00/0xf9b71aee447222a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee44722282 expref: -99 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.405971:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254c00/0xf9b71aee447222a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee44722282 expref: 22 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.405982:0:22797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254c00/0xf9b71aee447222a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee44722282 expref: 22 pid: 22797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.406001:0:22797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254c00, rc 0) 00000100:00100000:1.0:1788201617.406052:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:22800:x1875064681400832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201617.406058:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201617.406128:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201617.406144:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0e00/0xf9b71aee44722282 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222a5 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.406153:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0e00/0xf9b71aee44722282 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447222a5 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.406222:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.406250:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.406398:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.406479:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681400960 00000100:00100000:0.0:1788201617.406484:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681400960 00000100:00100000:0.0:1788201617.406506:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201617.406513:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:22800:x1875064681400960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.406641:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:22800:x1875064681400960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.406648:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201617.406894:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681400960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.406929:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.406965:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.406981:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.407035:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681401088 00000100:00100000:0.0:1788201617.407039:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681401088 00000100:00100000:0.0:1788201617.407056:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201617.407061:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:22800:x1875064681401088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.407195:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:22800:x1875064681401088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.407202:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201617.407263:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201617.408399:0:25850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:0.0:1788201617.408603:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000020:01000000:0.0:1788201617.408638:0:22800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788201617.408662:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201617.408670:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0e00/0xf9b71aee44722282 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222a5 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.408681:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0816a0e00/0xf9b71aee44722282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222a5 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201617.408704:0:22800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201617.408707:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0aafde000 from 13 10000000:01000000:0.0:1788201617.408710:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201617.408754:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297200/0xf9b71aee447222ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.408762:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9cdf83297200/0xf9b71aee447222ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.408782:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9cdf83297200/0xf9b71aee447222ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.408801:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.408839:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201617.408868:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.408886:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681401216 00000100:00100000:0.0:1788201617.408891:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681401216 00000100:00100000:0.0:1788201617.408918:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201617.408926:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+22:22800:x1875064681401216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201617.408937:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201617.408949:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83297600/0xf9b71aee447222b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447222ac expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.408969:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83297600/0xf9b71aee447222b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447222ac expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.408979:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83297600/0xf9b71aee447222b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447222ac expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.408998:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83297600, rc 0) 00000100:00100000:0.0:1788201617.409033:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681401216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.409040:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201617.409272:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201617.409289:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9cdf83297200/0xf9b71aee447222ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222b3 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.409297:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9cdf83297200/0xf9b71aee447222ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447222b3 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.409348:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.409373:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201617.409386:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.409398:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681401344 00000100:00100000:0.0:1788201617.409401:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681401344 00000100:00100000:0.0:1788201617.409418:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201617.409424:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681401344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.409514:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681401344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.409520:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201617.409549:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.409575:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.409611:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.410730:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662418560 00000100:00100000:3.0:1788201617.410749:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662418560 00000100:00100000:3.0:1788201617.410814:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:3.0:1788201617.410822:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+11:18715:x1875064662418560:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201617.410841:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201617.410857:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee447222ba lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6d2 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.410931:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.410944:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.410954:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201617.410975:0:22805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201617.410979:0:22805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201617.410994:0:22805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.411017:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee447222ba lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 13 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.411049:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.411058:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:3.0:1788201617.411061:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201617.411064:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74e00, rc 0) 00000100:00100000:3.0:1788201617.411114:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c996026-e1e6-4ca6-95c7-019447b48375+12:18715:x1875064662418560:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 293us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201617.411120:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1788201617.411323:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0ba3b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.411340:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681401472 00000100:00100000:0.0:1788201617.411344:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681401472 00000100:00100000:0.0:1788201617.411367:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201617.411373:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681401472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.411466:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681401472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.411473:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201617.411518:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201617.413053:0:25851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788201617.413272:0:22800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788201617.413297:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201617.413307:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9cdf83297200/0xf9b71aee447222ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222b3 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.413317:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9cdf83297200/0xf9b71aee447222ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222b3 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201617.413327:0:22800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201617.413330:0:22800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ce0b62a4800 from 13 10000000:01000000:2.0:1788201617.413333:0:22800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201617.413363:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bae00/0xf9b71aee447222c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.413371:0:22800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9ce0855bae00/0xf9b71aee447222c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.413381:0:22800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9ce0855bae00/0xf9b71aee447222c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201617.413402:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201617.413455:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201617.413524:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf837333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.413682:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681401600 00000100:00100000:0.0:1788201617.413689:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681401600 00000100:00100000:0.0:1788201617.413846:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201617.413856:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+23:22800:x1875064681401600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201617.413869:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201617.413882:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce0a03af600/0xf9b71aee447222cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b71aee447222c8 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.413904:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce0a03af600/0xf9b71aee447222cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf9b71aee447222c8 expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.413913:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce0a03af600/0xf9b71aee447222cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf9b71aee447222c8 expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.413921:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03af600, rc 0) 00000100:00100000:0.0:1788201617.413972:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681401600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.413979:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201617.414054:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201617.414067:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9ce0855bae00/0xf9b71aee447222c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222cf expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.414077:0:22800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9ce0855bae00/0xf9b71aee447222c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf9b71aee447222cf expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.414130:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.414157:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.414295:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201617.414354:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681401728 00000100:00100000:2.0:1788201617.414359:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681401728 00000100:00100000:2.0:1788201617.414380:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201617.414386:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681401728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201617.414493:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681401728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.414500:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201617.414568:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.414595:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201617.414642:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.414660:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201617.414695:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681401856 00000100:00100000:2.0:1788201617.414699:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681401856 00000100:00100000:2.0:1788201617.414715:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788201617.414720:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681401856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201617.414831:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:22800:x1875064681401856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.414838:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201617.415452:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:22800:1875064681401856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201617.415635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.415780:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662418688 00000100:00100000:3.0:1788201617.415786:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662418688 00000100:00100000:3.0:1788201617.415825:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1788201617.415833:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c996026-e1e6-4ca6-95c7-019447b48375+12:18715:x1875064662418688:12345-192.168.203.2@tcp:37:lfs.0 00000040:00080000:0.0:1788201617.424041:0:25852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788201617.424329:0:22800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788201617.424355:0:22800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201617.424365:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9ce0855bae00/0xf9b71aee447222c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222cf expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.424376:0:22800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9ce0855bae00/0xf9b71aee447222c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf9b71aee447222cf expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.435221:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c996026-e1e6-4ca6-95c7-019447b48375+12:18715:x1875064662418688:12345-192.168.203.2@tcp:37:lfs.0 Request processed in 19378us (19578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201617.435243:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1788201617.445665:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.451699:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662418944 00000100:00100000:2.0:1788201617.451713:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662418944 00000100:00100000:2.0:1788201617.451809:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1788201617.451819:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c996026-e1e6-4ca6-95c7-019447b48375+12:18715:x1875064662418944:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201617.452054:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c996026-e1e6-4ca6-95c7-019447b48375+13:18715:x1875064662418944:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 236us (6397us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788201617.452062:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:3.0:1788201617.475105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201617.475346:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419072 00000100:00100000:1.0:1788201617.475356:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419072 00000100:00100000:1.0:1788201617.475414:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:1.0:1788201617.475425:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+11:18082:x1875064662419072:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201617.475442:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201617.475459:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83254a00/0xf9b71aee447222d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6d9 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.475488:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83254a00/0xf9b71aee447222d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d9 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.475499:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83254a00/0xf9b71aee447222d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d9 expref: 12 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.475508:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83254a00, rc 0) 00000100:00100000:1.0:1788201617.475568:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+12:18082:x1875064662419072:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 144us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201617.475575:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:1.0:1788201617.479844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.479979:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419200 00000100:00100000:2.0:1788201617.479989:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419200 00000100:00100000:2.0:1788201617.480047:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:2.0:1788201617.480056:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+12:18082:x1875064662419200:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201617.480216:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+12:18082:x1875064662419200:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 160us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.480222:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:3.0:1788201617.485983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.486652:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419328 00000100:00100000:0.0:1788201617.486663:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419328 00000100:00100000:0.0:1788201617.486723:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:0.0:1788201617.486734:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+12:18082:x1875064662419328:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.486965:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+12:18082:x1875064662419328:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 232us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.486973:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:3.0:1788201617.499364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201617.499455:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419456 00000100:00100000:1.0:1788201617.499465:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419456 00000100:00100000:1.0:1788201617.499527:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:1.0:1788201617.499548:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b977fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+12:18082:x1875064662419456:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201617.499579:0:22798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201617.499597:0:22798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cdf83255a00/0xf9b71aee447222dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6e0 expref: -99 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.499626:0:22798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cdf83255a00/0xf9b71aee447222dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6e0 expref: 13 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.499637:0:22798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cdf83255a00/0xf9b71aee447222dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6e0 expref: 13 pid: 22798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201617.499646:0:22798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cdf83255a00, rc 0) 00000100:00100000:1.0:1788201617.499707:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b977fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:faacd08d-6bc4-48af-a10c-977150f7f541+13:18082:x1875064662419456:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 171us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201617.499713:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:3.0:1788201617.504187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.504297:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419584 00000100:00100000:2.0:1788201617.504307:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419584 00000100:00100000:2.0:1788201617.504364:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:2.0:1788201617.504374:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:18082:x1875064662419584:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201617.504514:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:18082:x1875064662419584:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 140us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.504522:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:3.0:1788201617.521477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.521594:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419712 00000100:00100000:0.0:1788201617.521611:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419712 00000100:00100000:0.0:1788201617.521690:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:0.0:1788201617.521701:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+13:18082:x1875064662419712:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201617.521912:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:faacd08d-6bc4-48af-a10c-977150f7f541+13:18082:x1875064662419712:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 212us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.521920:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:0.0:1788201617.540623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.540849:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419840 00000100:00100000:2.0:1788201617.540863:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419840 00000100:00100000:2.0:1788201617.540945:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:2.0:1788201617.540957:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+11:18722:x1875064662419840:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1788201617.540977:0:24337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201617.540997:0:24337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447222e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6e7 expref: -99 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541062:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541076:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541105:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541117:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541125:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541132:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541205:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855baa00/0xf9b71aee447222f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541214:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855baa00/0xf9b71aee447222f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541220:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855baa00/0xf9b71aee447222f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201617.541253:0:24337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201617.541257:0:24337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201617.541291:0:24337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855baa00/0xf9b71aee447222f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541303:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541309:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541326:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541333:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.541337:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541344:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541355:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:2.0:1788201617.541358:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.541363:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541368:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee447222eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541382:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541388:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541393:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541397:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.541399:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541414:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541423:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce086386800) 00010000:00010000:2.0:1788201617.541426:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.541431:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541436:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447222f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541462:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447222e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6e7 expref: 13 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541475:0:24337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855baa00/0xf9b71aee447222f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6e7 expref: 12 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.541482:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:2.0:1788201617.541485:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201617.541487:0:24337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855baa00, rc 0) 00000100:00100000:2.0:1788201617.541666:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+12:18722:x1875064662419840:12345-192.168.203.2@tcp:101:bash.0 Request processed in 709us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.541673:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:3.0:1788201617.544461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201617.544940:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662419968 00000100:00100000:0.0:1788201617.544955:0:22815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662419968 00000100:00100000:0.0:1788201617.545057:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1788201617.545068:0:22815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:18722:x1875064662419968:12345-192.168.203.2@tcp:900:bash.0 00000100:00100000:0.0:1788201617.545166:0:22815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:18722:x1875064662419968:12345-192.168.203.2@tcp:900:bash.0 Request processed in 100us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.545175:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1788201617.554470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.554551:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662420224 00000100:00100000:3.0:1788201617.554560:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662420224 00000100:00100000:3.0:1788201617.554618:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:3.0:1788201617.554628:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+12:18722:x1875064662420224:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1788201617.554657:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201617.554676:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44722300 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6ee expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.554814:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.554829:0:22805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.554854:0:22805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.554885:0:22805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.554899:0:22805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 12 pid: 22805 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201617.554912:0:22805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22805:1875064681401984:192.168.203.2@tcp:104: 00000100:00100000:3.0:1788201617.554984:0:22805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201617.558288:0:22805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf82394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22805:1875064681401984:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201617.558330:0:22805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.565364:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.565512:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662420352 00000100:00100000:2.0:1788201617.565526:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662420352 00010000:00010000:2.0:1788201617.565581:0:22790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 13 pid: 22805 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201617.565664:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1788201617.565675:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c996026-e1e6-4ca6-95c7-019447b48375+13:2398:x1875064662420352:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201617.565691:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201617.565698:0:22790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 13 pid: 22805 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.565711:0:22790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 13 pid: 22805 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.565732:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74e00/0xf9b71aee447222c1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6d2 expref: 13 pid: 22805 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.565803:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:2.0:1788201617.565808:0:22790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.565819:0:22790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.565826:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.565862:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201617.565923:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c996026-e1e6-4ca6-95c7-019447b48375+12:2398:x1875064662420352:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 248us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.565932:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00010000:00010000:3.0:1788201617.565958:0:22805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.565973:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.566006:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.566020:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.566032:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572270:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572318:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572334:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201617.572350:0:22805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788201617.572387:0:22805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572395:0:22805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572403:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572411:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201617.572415:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572422:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572436:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:2.0:1788201617.572440:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201617.572445:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572451:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74800/0xf9b71aee44722307 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201617.572470:0:22805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004adaa26e reply state 00000000b4edc368 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572506:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572514:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ce086386500) 00010000:00010000:2.0:1788201617.572517:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201617.572521:0:22805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201617.572570:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75000/0xf9b71aee44722300 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 15 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572587:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 14 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201617.572594:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201617.572596:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788201617.572599:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba000, rc 0) 00000100:00100000:2.0:1788201617.572711:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+15:18722:x1875064662420224:12345-192.168.203.2@tcp:101:bash.0 Request processed in 18083us (18249us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788201617.572720:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:0.0:1788201617.596705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.597005:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662420480 00000100:00100000:2.0:1788201617.597019:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662420480 00000100:00100000:0.0:1788201617.597183:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:0.0:1788201617.597195:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+15:18722:x1875064662420480:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1788201617.597230:0:24337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201617.597255:0:24337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44722323 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6f5 expref: -99 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.597336:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.597351:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.597363:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201617.597421:0:24337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788201617.597426:0:24337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201617.597452:0:24337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.597463:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.597492:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03ae400/0xf9b71aee44722323 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 17 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.597513:0:24337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 16 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.597537:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:0.0:1788201617.597541:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201617.597544:0:24337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03aea00, rc 0) 00000100:00100000:0.0:1788201617.599444:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+16:18722:x1875064662420480:12345-192.168.203.2@tcp:101:bash.0 Request processed in 2236us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.599457:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:3.0:1788201617.612050:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.615001:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662420736 00000100:00100000:2.0:1788201617.615021:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662420736 00000100:00100000:2.0:1788201617.615172:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1788201617.615189:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+16:18722:x1875064662420736:12345-192.168.203.2@tcp:35:bash.0 00000001:00080000:2.0:1788201617.615481:0:22806:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:2.0:1788201617.615641:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+18:18722:x1875064662420736:12345-192.168.203.2@tcp:35:bash.0 Request processed in 458us (3602us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1788201617.615672:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000020:00080000:2.0:1788201617.615678:0:22806:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201617.707407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.707779:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662420992 00000100:00100000:3.0:1788201617.707793:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662420992 00000100:00100000:3.0:1788201617.707900:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:3.0:1788201617.707912:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+18:18733:x1875064662420992:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201617.707945:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201617.707973:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44722331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc6fc expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201617.708258:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788201617.708447:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44722331 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6fc expref: 20 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.708465:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce09d9f6e00) 00010000:00010000:3.0:1788201617.708468:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201617.708474:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44722331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6fc expref: 20 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.708491:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74600, rc 0) 00000100:00100000:3.0:1788201617.709040:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+19:18733:x1875064662420992:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1126us (2541us total) trans 12884901899 rc 301/301 00000100:00100000:3.0:1788201617.709049:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:0.0:1788201617.716719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.716995:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662421248 00000100:00100000:3.0:1788201617.717008:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662421248 00000100:00100000:3.0:1788201617.717094:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:3.0:1788201617.717108:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+19:18733:x1875064662421248:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1788201617.717470:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+20:18733:x1875064662421248:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 364us (764us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788201617.717479:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00010000:00010000:0.0:1788201617.720170:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201617.757151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.757242:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662421504 00000100:00100000:3.0:1788201617.757280:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662421504 00000100:00100000:3.0:1788201617.757351:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:3.0:1788201617.757362:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+20:18736:x1875064662421504:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1788201617.757394:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201617.757420:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee4472233f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc703 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.757896:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44722346 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.757917:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44722346 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.757930:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44722346 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201617.757942:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788201617.758073:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee4472233f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc703 expref: 23 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.758096:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44722346 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc703 expref: 22 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201617.758105:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:3.0:1788201617.758108:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201617.758112:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74000, rc 0) 00000100:00100000:3.0:1788201617.758186:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:18736:x1875064662421504:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 826us (1047us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788201617.758195:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:1.0:1788201617.761890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201617.761953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201617.761997:0:23959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662421760 00000100:00100000:3.0:1788201617.762010:0:23959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662421760 00000100:00100000:3.0:1788201617.762094:0:23959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1788201617.762107:0:23959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:2400:x1875064662421760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201617.762126:0:23959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201617.762163:0:23959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee44722346 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc703 expref: 22 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.762174:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662421632 00000100:00100000:0.0:1788201617.762181:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662421632 00010000:00010000:3.0:1788201617.762189:0:23959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:3.0:1788201617.762196:0:23959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201617.762230:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1788201617.762240:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0ba229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:18736:x1875064662421632:12345-192.168.203.2@tcp:54:lfs.0 00000100:00100000:3.0:1788201617.762266:0:23959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:2400:x1875064662421760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 162us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201617.762275:0:23959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00010000:00010000:0.0:1788201617.762319:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762336:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762362:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762406:0:22805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762428:0:22805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762458:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762465:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0a03afc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:0.0:1788201617.762470:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762479:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762489:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:0.0:1788201617.762492:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201617.762495:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201617.762501:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03afc00/0xf9b71aee44722354 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.762538:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0ba229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+21:18736:x1875064662421632:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 301us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.762545:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1788201617.768049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201617.768163:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662422016 00000100:00100000:2.0:1788201617.768178:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662422016 00000100:00100000:2.0:1788201617.768644:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1788201617.768659:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+21:18736:x1875064662422016:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1788201617.769032:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:18736:x1875064662422016:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 376us (998us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788201617.769041:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1788201618.046067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.048162:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662422272 00000100:00100000:2.0:1788201618.048183:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662422272 00000100:00100000:2.0:1788201618.048289:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:2.0:1788201618.048303:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:18767:x1875064662422272:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:2.0:1788201618.048341:0:24337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201618.048372:0:24337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472235b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc70a expref: -99 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.048556:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44722362 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.048575:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44722362 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.048589:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44722362 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201618.048602:0:24337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788201618.049662:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472235b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc70a expref: 25 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.049727:0:24337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44722362 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc70a expref: 24 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.050062:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.050067:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201618.050073:0:24337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba800, rc 0) 00000100:00100000:2.0:1788201618.050170:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+24:18767:x1875064662422272:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1869us (4116us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788201618.050181:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:1.0:1788201618.055235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.055289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.055384:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662422656 00000100:00100000:3.0:1788201618.055397:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662422656 00000100:00100000:3.0:1788201618.055474:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1788201618.055487:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+24:18767:x1875064662422656:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1788201618.055514:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662422400 00000100:00100000:2.0:1788201618.055521:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662422400 00000100:00100000:2.0:1788201618.055564:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:2.0:1788201618.055573:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+25:2401:x1875064662422400:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201618.055587:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201618.055617:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba800/0xf9b71aee44722362 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc70a expref: 25 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.055642:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.055649:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201618.055712:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b6c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+25:2401:x1875064662422400:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 141us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.055719:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:3.0:1788201618.055845:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+24:18767:x1875064662422656:12345-192.168.203.2@tcp:35:cat.0 Request processed in 360us (554us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788201618.055854:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1788201618.125457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201618.125617:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662422912 00000100:00100000:0.0:1788201618.125630:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662422912 00000100:00100000:0.0:1788201618.125704:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:0.0:1788201618.125715:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+24:18773:x1875064662422912:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:0.0:1788201618.125812:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201618.125959:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af800/0xf9b71aee44722370 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc711 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.126127:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.126144:0:22805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 25 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.126153:0:22805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 25 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.126163:0:22805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.126209:0:22805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 25 pid: 24337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.126224:0:22805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 25 pid: 24337 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201618.126239:0:22805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22805:1875064681402112:192.168.203.2@tcp:104: 00010000:00010000:0.0:1788201618.126360:0:22805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 25 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.126369:0:22805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 25 pid: 22805 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201618.126378:0:22805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22805:1875064681402240:192.168.203.2@tcp:104: 00000100:00100000:0.0:1788201618.126412:0:22805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cdf83733180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201618.133374:0:22805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22805:1875064681402112:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201618.133396:0:22805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22805:1875064681402240:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201618.133450:0:22805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201618.136238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.136354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.136650:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662423040 00000100:00100000:1.0:1788201618.136663:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662423040 00000100:00100000:0.0:1788201618.136693:0:23959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662423168 00000100:00100000:0.0:1788201618.136700:0:23959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662423168 00010000:00010000:1.0:1788201618.136717:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 27 pid: 24337 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.136726:0:23959:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 27 pid: 22805 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201618.136797:0:23959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1788201618.136808:0:23959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b255e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+27:2399:x1875064662423168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201618.136827:0:23959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201618.136952:0:23959:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 27 pid: 22805 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.136969:0:23959:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 27 pid: 22805 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201618.136974:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:1.0:1788201618.136988:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+27:2399:x1875064662423040:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201618.136998:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201618.137021:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 27 pid: 24337 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.137033:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 27 pid: 24337 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.137054:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aea00/0xf9b71aee4472232a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6f5 expref: 27 pid: 24337 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.137097:0:23959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722315 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc6ee expref: 26 pid: 22805 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.137117:0:23959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:0.0:1788201618.137123:0:23959:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.137135:0:23959:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.137144:0:23959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.137185:0:23959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201618.137216:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:1.0:1788201618.137222:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201618.137303:0:22805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.137313:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201618.137820:0:22805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00100000:1.0:1788201618.138141:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+26:2399:x1875064662423040:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1149us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.138142:0:23959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b255e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+26:2399:x1875064662423168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1330us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.138159:0:23959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1788201618.138420:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00010000:00010000:3.0:1788201618.140380:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03af800/0xf9b71aee44722370 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc711 expref: 25 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.140414:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0a03aee00/0xf9b71aee44722377 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc711 expref: 24 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.140425:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:3.0:1788201618.140429:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201618.140433:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0a03aee00, rc 0) 00000100:00100000:3.0:1788201618.140513:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+24:18773:x1875064662422912:12345-192.168.203.2@tcp:101:dd.0 Request processed in 14798us (15069us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1788201618.140524:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1788201618.154476:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.154684:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662423296 00000100:00100000:2.0:1788201618.154698:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662423296 00000100:00100000:2.0:1788201618.154825:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1788201618.154844:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+24:18773:x1875064662423296:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1788201618.154878:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201618.154904:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44722385 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc718 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.154947:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.154962:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.154973:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.155128:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee44722385 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 26 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.155150:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 25 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.155161:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.155164:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201618.155168:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bbc00, rc 0) 00000100:00100000:2.0:1788201618.155260:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf82394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+25:18773:x1875064662423296:12345-192.168.203.2@tcp:101:dd.0 Request processed in 426us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.155269:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:0.0:1788201618.163388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.163543:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662423552 00000100:00100000:1.0:1788201618.163555:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662423552 00000100:00100000:1.0:1788201618.163632:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:1.0:1788201618.163644:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+25:18773:x1875064662423552:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:1.0:1788201618.164188:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.164212:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.164225:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201618.164281:0:22804:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:1.0:1788201618.164307:0:22804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d646cb30 reply state 00000000095a11a2 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.164342:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.164351:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:1.0:1788201618.164354:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201618.164360:0:22804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201618.164640:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+28:18773:x1875064662423552:12345-192.168.203.2@tcp:36:dd.0 Request processed in 853us (1122us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788201618.164649:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000020:00080000:1.0:1788201618.164656:0:22804:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201618.171971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.174141:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662423680 00000100:00100000:2.0:1788201618.174162:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662423680 00000100:00100000:2.0:1788201618.174249:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:2.0:1788201618.174262:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+28:18773:x1875064662423680:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1788201618.174296:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201618.174325:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472239a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc71f expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.174404:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472239a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc71f expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.174421:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472239a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc71f expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.174445:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.174449:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201618.174454:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb600, rc 0) 00000100:00100000:2.0:1788201618.177516:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18773:x1875064662423680:12345-192.168.203.2@tcp:101:dd.0 Request processed in 3235us (5539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.177535:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:0.0:1788201618.191163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.194080:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662423936 00000100:00100000:2.0:1788201618.194101:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662423936 00000100:00100000:2.0:1788201618.194216:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:2.0:1788201618.194229:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18773:x1875064662423936:12345-192.168.203.2@tcp:103:dd.0 00010000:00010000:2.0:1788201618.194274:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201618.194308:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee4472239a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc71f expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.194334:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.194340:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201618.194432:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+28:18773:x1875064662423936:12345-192.168.203.2@tcp:103:dd.0 Request processed in 205us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.194440:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1788201618.197910:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.199017:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662424064 00000100:00100000:2.0:1788201618.199033:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662424064 00000100:00100000:2.0:1788201618.199133:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:2.0:1788201618.199147:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+28:18773:x1875064662424064:12345-192.168.203.2@tcp:58:dd.0 00010000:00010000:2.0:1788201618.199301:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.199324:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.199338:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201618.205204:0:22805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201618.205387:0:22805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788201618.206000:0:22805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788201618.206358:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+28:18773:x1875064662424064:12345-192.168.203.2@tcp:58:dd.0 Request processed in 7140us (8389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.206372:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:1.0:1788201618.217346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201618.217414:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662424192 00000100:00100000:0.0:1788201618.217428:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662424192 00000100:00100000:2.0:1788201618.218305:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:2.0:1788201618.218327:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+28:18773:x1875064662424192:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1788201618.218359:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201618.218393:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc726 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.218495:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.218507:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.218532:0:22802:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.218548:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.218562:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.218565:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201618.218569:0:22802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.218577:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bb600, rc 0) 00000100:00100000:2.0:1788201618.218659:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18773:x1875064662424192:12345-192.168.203.2@tcp:101:dd.0 Request processed in 341us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.218666:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000040:00080000:3.0:1788201618.423290:0:22839:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788201618.423304:0:22839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788201618.423337:0:22839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788201618.423349:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788201618.423532:0:22839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22839:1875064681402368:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788201618.423685:0:22839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0886e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201618.434722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.434832:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662424320 00000100:00100000:2.0:1788201618.434843:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662424320 00000100:00100000:3.0:1788201618.434865:0:22839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ce0bf4e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22839:1875064681402368:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788201618.434925:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:2.0:1788201618.434937:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18775:x1875064662424320:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201618.434978:0:22804:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201618.435148:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18775:x1875064662424320:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 212us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.435158:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1788201618.441231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.441401:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662424448 00000100:00100000:1.0:1788201618.441415:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662424448 00000100:00100000:1.0:1788201618.441861:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:1.0:1788201618.441875:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18775:x1875064662424448:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788201618.441971:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.441993:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442007:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442026:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442054:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442062:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442093:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442103:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442110:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201618.442173:0:24337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788201618.442178:0:24337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201618.442198:0:24337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442211:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442218:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442225:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442231:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2044c00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201618.442235:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442250:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442265:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce09d9f6600) 00010000:00010000:1.0:1788201618.442269:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201618.442274:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442281:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044c00/0xf9b71aee447223af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442412:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442419:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442550:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442940:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2044400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201618.442945:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442953:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442963:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9ce089cc2100) 00010000:00010000:1.0:1788201618.442967:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201618.442970:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.442991:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2044400/0xf9b71aee447223b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.443012:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.443018:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.443024:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.443028:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0c2045600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201618.443031:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.443036:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.443044:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:1.0:1788201618.443046:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201618.443049:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.443055:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045600/0xf9b71aee447223bd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201618.443156:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18775:x1875064662424448:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 1282us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201618.443167:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:1.0:1788201618.446397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.446666:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662424704 00000100:00100000:3.0:1788201618.446679:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662424704 00000100:00100000:3.0:1788201618.446813:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1788201618.446826:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+29:18775:x1875064662424704:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201618.446857:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201618.446883:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee447223c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc72d expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447022:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447039:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447052:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201618.447064:0:22805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788201618.447171:0:22805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447180:0:22805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447188:0:22805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447195:0:22805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74600 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201618.447219:0:22805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447229:0:22805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447244:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:3.0:1788201618.447248:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201618.447253:0:22805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447261:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee447223cb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447313:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee447223c4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc72d expref: 31 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447325:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce09d9f6600) 00010000:00010000:3.0:1788201618.447328:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201618.447332:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee447223c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc72d expref: 31 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.447343:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74000, rc 0) 00000100:00100000:3.0:1788201618.447442:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+30:18775:x1875064662424704:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 605us (1045us total) trans 12884901908 rc 301/301 00000100:00100000:3.0:1788201618.447451:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:1.0:1788201618.451619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.451902:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662424832 00000100:00100000:2.0:1788201618.451914:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662424832 00000100:00100000:2.0:1788201618.451984:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:2.0:1788201618.451996:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+30:18775:x1875064662424832:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788201618.452047:0:24337:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788201618.452229:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+30:18775:x1875064662424832:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 234us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.452238:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:3.0:1788201618.456219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.456320:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662425088 00000100:00100000:1.0:1788201618.456332:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662425088 00000100:00100000:1.0:1788201618.456409:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:1.0:1788201618.456423:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+30:18775:x1875064662425088:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201618.456463:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201618.456492:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045e00/0xf9b71aee447223d9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc734 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201618.457068:0:22805:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:1.0:1788201618.457081:0:22805:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788201618.457107:0:22805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1788201618.457287:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045000/0xf9b71aee447223e0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.457305:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045000/0xf9b71aee447223e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.457318:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045000/0xf9b71aee447223e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.457385:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045e00/0xf9b71aee447223d9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc734 expref: 33 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.457408:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045000/0xf9b71aee447223e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc734 expref: 32 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.457418:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce089cc2f00) 00010000:00010000:1.0:1788201618.457438:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201618.457443:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0c2045000, rc 0) 00000100:00100000:1.0:1788201618.457518:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+32:18775:x1875064662425088:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1098us (1312us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788201618.457527:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:1.0:1788201618.462396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.463174:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662425344 00000100:00100000:2.0:1788201618.463189:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662425344 00000100:00100000:2.0:1788201618.463327:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1788201618.463340:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+32:18775:x1875064662425344:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201618.463419:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201618.463462:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0c2045000/0xf9b71aee447223e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc734 expref: 32 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463486:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce089cc2f00) 00010000:00010000:2.0:1788201618.463735:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201618.463804:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463821:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463833:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463869:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463877:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463884:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463940:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463948:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463954:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463961:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba000 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201618.463965:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463972:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463981:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:2.0:1788201618.463984:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201618.463988:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.463994:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee447223ee lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.464012:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.464018:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.464024:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.464030:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201618.464034:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.464040:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.464047:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x2c95f5 (ffff9ce08b1eee00) 00010000:00010000:2.0:1788201618.464049:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201618.464052:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.464057:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee447223f5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2c95f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.464167:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+31:18775:x1875064662425344:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 829us (1785us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201618.464176:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1788201618.467203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.467367:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662425472 00000100:00100000:3.0:1788201618.467379:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662425472 00000100:00100000:3.0:1788201618.467617:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1788201618.467658:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+31:18775:x1875064662425472:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788201618.467686:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201618.467715:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee447223fc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc73b expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.467958:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44722403 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.467975:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44722403 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.467986:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44722403 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.468119:0:22805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74000/0xf9b71aee447223fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc73b expref: 33 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.468142:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74600/0xf9b71aee44722403 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc73b expref: 32 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.468152:0:22805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:3.0:1788201618.468156:0:22805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201618.468160:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce098a74600, rc 0) 00000100:00100000:3.0:1788201618.468270:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+32:18775:x1875064662425472:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 615us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.468278:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1788201618.471896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.472012:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662425728 00000100:00100000:3.0:1788201618.472025:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662425728 00000100:00100000:3.0:1788201618.472393:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:3.0:1788201618.472426:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+32:18775:x1875064662425728:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788201618.473824:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.473851:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.473865:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201618.476368:0:22802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1788201618.476412:0:22802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698773671459ns, next at 699773664679ns, rc = 0 00000004:00010000:3.0:1788201618.476525:0:22802:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abd2de38 reply state 000000001bf82de0 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.476549:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.476569:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:3.0:1788201618.476573:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788201618.476578:0:22802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201618.476770:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+34:18775:x1875064662425728:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 4313us (4851us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788201618.476781:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:1.0:1788201618.481538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.481653:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662425856 00000100:00100000:2.0:1788201618.481666:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662425856 00000100:00100000:2.0:1788201618.481786:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:2.0:1788201618.481817:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+34:18775:x1875064662425856:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201618.481852:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201618.481880:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc742 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.481972:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 35 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.481989:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 35 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.482012:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:2.0:1788201618.482016:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201618.482020:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855ba400, rc 0) 00000100:00100000:2.0:1788201618.482086:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+35:18775:x1875064662425856:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 273us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.482094:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:1.0:1788201618.485284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.485419:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662425984 00000100:00100000:3.0:1788201618.485593:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662425984 00000100:00100000:3.0:1788201618.485861:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1788201618.485876:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2398:x1875064662425984:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788201618.486223:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2398:x1875064662425984:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 350us (951us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1788201618.486249:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00080000:2.0:1788201618.487203:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201618.491376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.492550:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662426240 00000100:00100000:3.0:1788201618.492566:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662426240 00000100:00100000:2.0:1788201618.492824:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1788201618.492838:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+35:18775:x1875064662426240:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788201618.493165:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+36:18775:x1875064662426240:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 329us (1802us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788201618.493173:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:0.0:1788201618.497875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.498040:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662426496 00000100:00100000:2.0:1788201618.498054:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662426496 00000100:00100000:2.0:1788201618.498239:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:2.0:1788201618.498284:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+36:18775:x1875064662426496:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788201618.498456:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+36:18775:x1875064662426496:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 179us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.498464:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:3.0:1788201618.503699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.506931:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662426624 00000100:00100000:2.0:1788201618.506952:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662426624 00000100:00100000:2.0:1788201618.507219:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:2.0:1788201618.507232:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+36:18775:x1875064662426624:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788201618.507259:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201618.507450:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722418 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc749 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.507547:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472241f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.507670:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472241f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.507683:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472241f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201618.507869:0:22804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201618.507895:0:22804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472241f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.507929:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba000/0xf9b71aee44722418 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc749 expref: 38 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.507953:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472241f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc749 expref: 37 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.507983:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:2.0:1788201618.507987:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788201618.507991:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bba00, rc 0) 00000100:00100000:2.0:1788201618.508138:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+37:18775:x1875064662426624:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 908us (4452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.508155:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1788201618.521878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.522265:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662426752 00000100:00100000:1.0:1788201618.522279:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662426752 00000100:00100000:1.0:1788201618.522353:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1788201618.522365:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+6:2399:x1875064662426752:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201618.522680:0:24313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201618.522709:0:24313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc750 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201618.522881:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95ca91, blocks: 0x0 00010000:00010000:1.0:1788201618.522909:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1788201618.522915:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201618.522927:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 7 pid: 24313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.522952:0:24313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 7 pid: 24313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.522969:0:24313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0c2044c00, rc 0) 00000100:00100000:1.0:1788201618.523073:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2399:x1875064662426752:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 708us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201618.523080:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1788201618.530049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.530270:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662427008 00000100:00100000:3.0:1788201618.530282:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662427008 00000100:00100000:3.0:1788201618.530375:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:3.0:1788201618.530387:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+37:18775:x1875064662427008:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788201618.531188:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+37:18775:x1875064662427008:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 799us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.531200:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:2.0:1788201618.534939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.535548:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662427136 00000100:00100000:3.0:1788201618.535620:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662427136 00000100:00100000:3.0:1788201618.535784:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:3.0:1788201618.535799:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+37:18775:x1875064662427136:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788201618.541449:0:22783:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:0.0:1788201618.541482:0:22783:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788201618.541566:0:22783:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1788201618.541778:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.541793:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.541803:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.541810:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:1.0:1788201618.541815:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.541825:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.541846:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:1.0:1788201618.541849:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788201618.541854:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.541861:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0400/0xf9b71aee4472226d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.542867:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+19:18775:x1875064662427136:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 7061us (7932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.542881:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:1.0:1788201618.543025:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201618.543049:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681402496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788201618.543132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201618.543215:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681402496 00000100:00100000:1.0:1788201618.543225:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681402496 00000100:00100000:1.0:1788201618.543303:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201618.543313:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681402496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788201618.543508:0:24314:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201618.543512:0:24314:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788201618.543515:0:24314:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788201618.543517:0:24314:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788201617 -> 1788201617 00002000:00010000:1.0:1788201618.543520:0:24314:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788201618.543560:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875064681402496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (427us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788201618.543567:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788201618.543592:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788201618.543629:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cdf841c3b80/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788201618.543637:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681402496:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788201618.547439:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547461:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547469:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547476:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0816a0800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201618.547481:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547511:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547532:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce086386800) 00010000:00010000:3.0:1788201618.547535:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201618.547541:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547547:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0816a0800/0xf9b71aee44722219 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547581:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547588:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547593:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547597:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bac00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201618.547600:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547606:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547615:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce08b1ee900) 00010000:00010000:3.0:1788201618.547617:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201618.547620:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547632:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee44722220 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547651:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547657:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547663:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547668:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74200 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201618.547671:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547676:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547684:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ce086386500) 00010000:00010000:3.0:1788201618.547686:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201618.547689:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547694:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a74200/0xf9b71aee4472230e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547709:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547715:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547725:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.547730:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cdf83255400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201618.547733:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201618.548269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.548691:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662427264 00000100:00100000:1.0:1788201618.548705:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662427264 00000100:00100000:1.0:1788201618.548808:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1788201618.548887:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0aba02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2398:x1875064662427264:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788201618.549103:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0aba02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2398:x1875064662427264:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 220us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201618.549112:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00010000:00010000:3.0:1788201618.549872:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.549895:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:3.0:1788201618.551017:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201618.551029:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551041:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cdf83255400/0xf9b71aee44722393 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551077:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551084:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551093:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551100:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75800 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:3.0:1788201618.551103:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551138:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551151:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:3.0:1788201618.551154:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201618.551157:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.551163:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee4472240a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201618.551377:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201618.551401:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681402624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201618.551481:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201618.551537:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf823ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681402752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201618.551577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201618.551600:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201618.551606:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681402880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201618.551633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.551806:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681402880 00000100:00100000:2.0:1788201618.551815:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681402880 00000100:00100000:2.0:1788201618.551893:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788201618.552044:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201618.552282:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681402624 00000100:00100000:3.0:1788201618.552287:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681402624 00000100:00100000:3.0:1788201618.552320:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681402752 00000100:00100000:3.0:1788201618.552324:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681402752 00000100:00100000:3.0:1788201618.552340:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201618.552349:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681402624:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201618.552512:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681402880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201618.552552:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788201618.552630:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681402880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.552637:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201618.552695:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201618.552704:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681402752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201618.552733:0:22809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788201618.552801:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681402752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.552808:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000004:00000024:3.0:1788201618.553718:0:23544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788201618.553808:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875064681402624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1460us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.553817:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201618.553878:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875064681402624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201618.554202:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681402880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201618.554221:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf823ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681402752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201618.558303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.558456:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662427520 00000100:00100000:2.0:1788201618.558469:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662427520 00000100:00100000:2.0:1788201618.558545:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:2.0:1788201618.558781:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+15:18775:x1875064662427520:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788201618.558855:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201618.558891:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee4472241f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc749 expref: 15 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.558927:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:2.0:1788201618.558933:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201618.558974:0:24337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee4472242d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.558989:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee4472242d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.559001:0:24337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee4472242d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201618.559165:0:24337:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e63388d7 reply state 00000000c1ef526a transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee4472242d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.559180:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba200/0xf9b71aee4472242d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.559186:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:2.0:1788201618.559189:0:24337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201618.559191:0:24337:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201618.559322:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+16:18775:x1875064662427520:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 767us (1033us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1788201618.559365:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:2.0:1788201618.564201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.564362:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662427648 00000100:00100000:1.0:1788201618.564375:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662427648 00000100:00100000:1.0:1788201618.564543:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1788201618.564775:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:18775:x1875064662427648:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788201618.564823:0:24314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201618.564846:0:24314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc757 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.564890:0:24314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 8 pid: 24313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.564912:0:24314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201618.564917:0:24314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201618.564923:0:24314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 8 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.564966:0:24314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 8 pid: 24313 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.564981:0:24314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 8 pid: 24313 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201618.564997:0:24314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24314:1875064681403008:192.168.203.2@tcp:104: 00000100:00100000:1.0:1788201618.565101:0:24314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce09015fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201618.570020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.570440:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662427776 00000100:00100000:2.0:1788201618.570453:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662427776 00010000:00010000:2.0:1788201618.570510:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 9 pid: 24313 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.570610:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1788201618.570623:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:2398:x1875064662427776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201618.570642:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201618.570668:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 9 pid: 24313 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.570686:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 9 pid: 24313 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.570717:0:22788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201618.570722:0:22788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201618.570771:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 9 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.570785:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 9 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.570830:0:22788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 9 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.570867:0:22788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22788:1875064681403136:192.168.203.2@tcp:105: 00010000:00010000:1.0:1788201618.570953:0:24314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b63a20/0xf9b71aee44722426 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc750 expref: 9 pid: 24313 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.570970:0:22788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201618.570979:0:24314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24314:1875064681403008:192.168.203.2@tcp:104: 00010000:00010000:1.0:1788201618.571020:0:24314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 8 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.571041:0:24314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0c2045800, rc 0) 00000100:00100000:1.0:1788201618.571076:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+8:18775:x1875064662427648:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 6522us (6889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201618.571084:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:2.0:1788201618.574606:0:22788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22788:1875064681403136:192.168.203.2@tcp:105: 00010000:00010000:2.0:1788201618.574664:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201618.574800:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2398:x1875064662427776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4177us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.574813:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201618.576776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.577325:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662427904 00000100:00100000:1.0:1788201618.577339:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662427904 00000100:00100000:1.0:1788201618.577411:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:1.0:1788201618.577423:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2399:x1875064662427904:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788201618.579072:0:24313:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201618.579081:0:24313:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788201617 00002000:00010000:1.0:1788201618.579085:0:24313:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788201616 00002000:00010000:1.0:1788201618.579087:0:24313:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788201617 -> 1788201617 00002000:00010000:1.0:1788201618.579089:0:24313:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788201618.579182:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+8:2399:x1875064662427904:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 1755us (2440us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788201618.579193:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:0.0:1788201618.587963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.588109:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662428032 00000100:00100000:2.0:1788201618.588123:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662428032 00000100:00100000:2.0:1788201618.588237:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:2.0:1788201618.588249:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+8:2398:x1875064662428032:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788201618.588317:0:24846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.588344:0:24846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 8 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.588354:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201618.588360:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201618.588365:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.588412:0:24846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 8 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.588463:0:24846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 8 pid: 24314 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.588484:0:24846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24846:1875064681403264:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201618.588601:0:24846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201618.592039:0:24846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24846:1875064681403264:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201618.592107:0:24846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201618.592407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.592920:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662428160 00000100:00100000:2.0:1788201618.592929:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662428160 00010000:00010000:2.0:1788201618.592975:0:22790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 9 pid: 24314 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.593022:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1788201618.593033:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:2398:x1875064662428160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201618.593052:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201618.593078:0:22790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 9 pid: 24314 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.593092:0:22790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 9 pid: 24314 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.593141:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064a226af/0xf9b71aee44722434 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc757 expref: 9 pid: 24314 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.593161:0:22790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201618.593166:0:22790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201618.593172:0:22790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.593183:0:22790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.593222:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201618.593298:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+8:2398:x1875064662428160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 265us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.593306:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00010000:00010000:1.0:1788201618.593999:0:24846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594014:0:24846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594047:0:24846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594071:0:24846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594080:0:24846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594087:0:24846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:1.0:1788201618.594092:0:24846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594101:0:24846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594116:0:24846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201618.594123:0:24846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000397c982b/0xf9b71aee4472243b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201618.594355:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2398:x1875064662428032:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 6105us (6402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201618.594366:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:0.0:1788201618.599487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.600049:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662428416 00000100:00100000:2.0:1788201618.600061:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662428416 00000100:00100000:2.0:1788201618.600139:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:2.0:1788201618.600152:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+16:18775:x1875064662428416:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788201618.600271:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.600293:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 16 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.600303:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.600368:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 16 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.600383:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 16 pid: 22802 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.600400:0:22804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22804:1875064681403392:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201618.600511:0:22804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f14600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201618.604075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.604221:0:23959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662428544 00000100:00100000:3.0:1788201618.604233:0:23959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662428544 00010000:00010000:3.0:1788201618.604296:0:23959:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 17 pid: 22802 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201618.604348:0:23959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201618.604383:0:23959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+17:2398:x1875064662428544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201618.604402:0:23959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201618.604410:0:23959:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 17 pid: 22802 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.604425:0:23959:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 17 pid: 22802 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.604453:0:23959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:3.0:1788201618.604460:0:23959:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 17 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.604473:0:23959:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.604482:0:23959:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.604490:0:23959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.604855:0:23959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201618.604983:0:23959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+17:2398:x1875064662428544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 607us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.604993:0:23959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00010000:00010000:2.0:1788201618.605108:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee4472238c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc718 expref: 16 pid: 22802 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.605127:0:22804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22804:1875064681403392:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201618.605161:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.605171:0:22804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.605177:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.605487:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.606301:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 16 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.606312:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.606369:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 16 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.606391:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 16 pid: 22804 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.606410:0:22804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22804:1875064681403520:192.168.203.2@tcp:104: 00000100:00100000:2.0:1788201618.606506:0:22804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0b2f140c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201618.612164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.612684:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662428672 00000100:00100000:3.0:1788201618.612697:0:22790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662428672 00010000:00010000:3.0:1788201618.612785:0:22790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 17 pid: 22804 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201618.612861:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1788201618.612872:0:22790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+17:2398:x1875064662428672:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201618.612890:0:22790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201618.612909:0:22790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 17 pid: 22804 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.612926:0:22790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 17 pid: 22804 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.612956:0:22790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:3.0:1788201618.612966:0:22790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.612978:0:22790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.612988:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.613011:0:22790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201618.613162:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722411 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc742 expref: 17 pid: 22804 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.613189:0:22804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22804:1875064681403520:192.168.203.2@tcp:104: 00010000:00010000:2.0:1788201618.613238:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.613249:0:22804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.613257:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201618.613410:0:22790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+16:2398:x1875064662428672:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 538us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.613418:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000001:00080000:2.0:1788201618.613536:0:22804:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1788201618.613787:0:22804:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:2.0:1788201618.613831:0:22804:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788201618.614295:0:22804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22804:1875064681403648:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201618.614363:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.614509:0:22804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce085679000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201618.615145:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681403648 00000100:00100000:3.0:1788201618.615155:0:22809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681403648 00000100:00100000:3.0:1788201618.615385:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201618.615397:0:22809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22804:x1875064681403648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201618.615567:0:22809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22804:x1875064681403648:12345-0@lo:1000:mdt00_001.0 Request processed in 172us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.615575:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201618.615650:0:22804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22804:1875064681403648:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788201618.615933:0:22804:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:2.0:1788201618.616010:0:22804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22804:1875064681403776:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201618.616054:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.616522:0:22804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201618.616756:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681403776 00000100:00100000:0.0:1788201618.616771:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681403776 00000100:00100000:0.0:1788201618.616814:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201618.616823:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22804:x1875064681403776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201618.617014:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22804:x1875064681403776:12345-0@lo:1000:mdt00_001.0 Request processed in 191us (957us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788201618.617021:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201618.617177:0:22804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22804:1875064681403776:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788201618.617224:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617237:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617246:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617253:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bba00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201618.617258:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617276:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617296:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:2.0:1788201618.617300:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201618.617306:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617312:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bba00/0xf9b71aee44722449 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617351:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617374:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617380:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617386:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbe00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201618.617389:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617396:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617405:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.617408:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201618.617416:0:22804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617429:0:22804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617644:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.617685:0:22804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb600/0xf9b71aee447223a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc726 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.617698:0:22804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22804:1875064681403904:192.168.203.2@tcp:105: 00000100:00100000:2.0:1788201618.617827:0:22804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ce0c1ffee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201618.621847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1788201618.621920:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662428800 00000100:00100000:1.0:1788201618.621933:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662428800 00000100:00100000:2.0:1788201618.621998:0:22804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22804:1875064681403904:192.168.203.2@tcp:105: 00000100:00100000:1.0:1788201618.622012:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:1.0:1788201618.622043:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf834d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+20:18773:x1875064662428800:12345-192.168.203.2@tcp:49:dd.0 00010000:00010000:2.0:1788201618.622050:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622064:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbe00/0xf9b71aee447223a1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622103:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622120:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622132:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622145:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622153:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622161:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622169:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bbc00 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201618.622173:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622181:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622208:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.622211:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201618.622215:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622221:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bbc00/0xf9b71aee44722450 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622231:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622237:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622242:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622247:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855bb400 already unused, calling callback (ffffffffc1b2a4f0) 00010000:00010000:2.0:1788201618.622249:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622255:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622383:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.622386:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201618.622390:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.622396:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bb400/0xf9b71aee44722442 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201618.622440:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf834d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+20:18773:x1875064662428800:12345-192.168.203.2@tcp:49:dd.0 Request processed in 399us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201618.622449:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1788201618.625889:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf823ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+19:18775:x1875064662428416:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 25726us (26400us total) trans 12884901917 rc 0/0 00000040:00080000:0.0:1788201618.626680:0:22839:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788201618.626688:0:22839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788201618.626723:0:22839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000100:00100000:3.0:1788201618.627867:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.628022:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000020:00080000:2.0:1788201618.628033:0:22804:0:(tgt_main.c:807:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788201618.628074:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662428928 00000100:00100000:2.0:1788201618.628084:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662428928 00000100:00100000:2.0:1788201618.628136:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:2.0:1788201618.628148:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+19:18773:x1875064662428928:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1788201618.628173:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201618.628200:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722457 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea45f209b75bc75e expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.628243:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee4472245e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201618.628580:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788201618.629641:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee4472245e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.629672:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee4472245e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.630046:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855ba400/0xf9b71aee44722457 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc75e expref: 21 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.630257:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce0855bac00/0xf9b71aee4472245e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xea45f209b75bc75e expref: 20 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.630268:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce08b1eec00) 00010000:00010000:2.0:1788201618.630281:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201618.630285:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce0855bac00, rc 0) 00000100:00100000:2.0:1788201618.630351:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+20:18773:x1875064662428928:12345-192.168.203.2@tcp:101:dd.0 Request processed in 2205us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201618.630360:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:1.0:1788201618.641368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.641569:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662429184 00000100:00100000:3.0:1788201618.641590:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662429184 00000100:00100000:3.0:1788201618.641665:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1788201618.641678:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+20:18775:x1875064662429184:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788201618.642108:0:22807:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788201618.642156:0:22807:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:3.0:1788201618.642197:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.642219:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.642233:0:22807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.642244:0:22807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.642251:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.642586:0:22807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.642619:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201618.642795:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:18775:x1875064662429184:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 1117us (1438us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1788201618.642824:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000020:00080000:3.0:1788201618.642831:0:22807:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788201618.643271:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201618.643282:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.643291:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a75800 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:0.0:1788201618.643296:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.643305:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.643331:0:22791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce086386200) 00010000:00010000:0.0:1788201618.643334:0:22791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201618.643341:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.643346:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce098a75800/0xf9b71aee44722465 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201618.643361:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201618.643363:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201618.643365:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201618.676346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1788201618.676653:0:24317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662429312 00000100:00100000:2.0:1788201618.676667:0:24317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662429312 00000100:00100000:2.0:1788201618.676808:0:24317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1788201618.676821:0:24317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2398:x1875064662429312:12345-192.168.203.2@tcp:4:dd.0 00002000:00010000:2.0:1788201618.676894:0:24317:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a95ca91, atime: 0x6a95ca90, ctime: 0x6a95ca91, blocks: 0x0 00010000:00010000:2.0:1788201618.676917:0:24317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.676938:0:24317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1788201618.676944:0:24317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201618.676952:0:24317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.676969:0:24317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201618.685098:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201618.689427:0:24319:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788201618.689463:0:24319:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788201618.691938:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662429440 00000100:00100000:2.0:1788201618.691954:0:24319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662429440 00000100:00100000:3.0:1788201618.693168:0:25853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:3.0:1788201618.693190:0:25853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+9:2398:x1875064662429440:12345-192.168.203.2@tcp:4:dd.0 00010000:00010000:3.0:1788201618.693243:0:25853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.693267:0:25853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201618.693273:0:25853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201618.693281:0:25853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.693298:0:25853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201618.742278:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201618.778196:0:25132:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1788201618.778232:0:25132:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1788201618.778582:0:24317:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788201618.778588:0:24317:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788201617 -> 1788201618 00002000:00010000:2.0:1788201618.778591:0:24317:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788201617 -> 1788201618 00002000:00010000:2.0:1788201618.778593:0:24317:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788201618.778616:0:24317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.778649:0:24317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.778659:0:24317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.778667:0:24317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce0855ba400 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201618.778674:0:24317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.778695:0:24317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.778720:0:24317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.778728:0:24317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f47c23a/0xf9b71aee4472246c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.778915:0:24317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+7:2398:x1875064662429312:12345-192.168.203.2@tcp:4:dd.0 Request processed in 102088us (102577us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788201618.778927:0:24317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000001:00080000:1.0:1788201618.808817:0:25132:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788201618.811495:0:25853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788201618.811516:0:25853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788201618.811541:0:25853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.811589:0:25853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.811600:0:25853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.811609:0:25853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce098a74200 already unused, calling callback (ffffffffc0f1dfe0) 00010000:00010000:2.0:1788201618.811615:0:25853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.811627:0:25853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.811655:0:25853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201618.811664:0:25853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e6cd51/0xf9b71aee44722473 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201618.811910:0:25853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf8333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2398:x1875064662429440:12345-192.168.203.2@tcp:4:dd.0 Request processed in 118720us (126820us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788201618.811922:0:25853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:2.0:1788201619.062096:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201619.062130:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681404032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201619.062232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201619.062414:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404032 00000100:00100000:1.0:1788201619.062424:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404032 00000100:00100000:1.0:1788201619.062493:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201619.062504:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681404032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201619.062535:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3676631040 00000100:00100000:1.0:1788201619.062599:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875064681404032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201619.062607:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201619.063934:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1788201619.063944:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cdf841c3b80, transno 12884901892 00000004:00080000:0.0:1788201619.063956:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1788201619.064010:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875064681404032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201619.064924:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681404288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065034:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681404800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065069:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681405312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065130:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201619.065134:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681404416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065162:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681404928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065189:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681405440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065229:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404288 00000100:00100000:2.0:1788201619.065237:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404288 00000100:00100000:2.0:1788201619.065281:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201619.065290:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681404288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065342:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681404288:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.065349:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201619.065371:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404800 00000100:00100000:2.0:1788201619.065374:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404800 00000100:00100000:2.0:1788201619.065392:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404416 00000100:00100000:2.0:1788201619.065394:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404416 00000100:00100000:2.0:1788201619.065414:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404928 00000100:00100000:2.0:1788201619.065416:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404928 00000100:00100000:2.0:1788201619.065432:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201619.065444:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681404800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065472:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681404800:12345-0@lo:400:kworker.0 Request processed in 30us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.065478:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201619.065488:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201619.065492:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681404416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065512:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681404416:12345-0@lo:400:kworker.0 Request processed in 19us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.065517:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201619.065525:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201619.065529:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681404928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065548:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875064681404928:12345-0@lo:400:kworker.0 Request processed in 19us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.065553:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788201619.065566:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201619.065571:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201619.065595:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681404416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065605:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681404928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065613:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681404288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065621:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875064681404800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065647:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681404160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065704:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681404672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065799:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681405184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065845:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788201619.065851:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681404544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065887:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf834cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681405056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065918:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf841baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681405568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.065938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.065957:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681405312 00000100:00100000:2.0:1788201619.065961:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681405312 00000100:00100000:2.0:1788201619.065987:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681405440 00000100:00100000:2.0:1788201619.065990:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681405440 00000100:00100000:2.0:1788201619.065999:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681405184 00000100:00100000:2.0:1788201619.066001:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681405184 00000100:00100000:2.0:1788201619.066011:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404544 00000100:00100000:2.0:1788201619.066013:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404544 00000100:00100000:2.0:1788201619.066022:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681405056 00000100:00100000:2.0:1788201619.066024:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681405056 00000100:00100000:2.0:1788201619.066033:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681405568 00000100:00100000:2.0:1788201619.066034:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681405568 00000100:00100000:2.0:1788201619.066045:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201619.066050:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681405312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066081:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875064681405312:12345-0@lo:400:kworker.0 Request processed in 30us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.066086:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201619.066096:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201619.066107:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681405440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066129:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875064681405440:12345-0@lo:400:kworker.0 Request processed in 24us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.066135:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201619.066144:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201619.066149:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681405184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066171:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875064681405184:12345-0@lo:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.066177:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201619.066186:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201619.066191:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681404544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066213:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875064681404544:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.066218:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201619.066226:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201619.066231:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681405056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066248:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875064681405056:12345-0@lo:400:kworker.0 Request processed in 18us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.066253:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201619.066261:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201619.066266:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681405568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066283:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875064681405568:12345-0@lo:400:kworker.0 Request processed in 17us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.066289:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788201619.066301:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201619.066308:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201619.066327:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875064681405440:0@lo:400:kworker.0 00010000:00080000:2.0:1788201619.066341:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf834ce300 x1875064681405312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201619.066352:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875064681405312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066372:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875064681404544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066380:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875064681405056:0@lo:400:kworker.0 00010000:00080000:2.0:1788201619.066388:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cdf841baa00 x1875064681405568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201619.066396:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875064681405568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.066404:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf834cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875064681405184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201619.070123:0:23544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404672 00000100:00100000:1.0:1788201619.070137:0:23544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404672 00000100:00100000:1.0:1788201619.070213:0:23544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201619.070226:0:23544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681404672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201619.070345:0:23544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681404672:12345-0@lo:400:kworker.0 Request processed in 122us (4607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201619.070353:0:23544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201619.070407:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681404160 00000100:00100000:1.0:1788201619.070412:0:22798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681404160 00000100:00100000:1.0:1788201619.070444:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201619.070451:0:22798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3645:x1875064681404160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201619.070510:0:22798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a+24:3645:x1875064681404160:12345-0@lo:400:kworker.0 Request processed in 59us (4829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201619.070516:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788201619.071020:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681405696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201619.071074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201619.071133:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4dbddb8-3fa4-41c9-abc0-3f65a23fe59a:3645:1875064681404160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201619.071153:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf841c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681404672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201619.074890:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681405696 00000100:00100000:1.0:1788201619.074912:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681405696 00000100:00100000:1.0:1788201619.074995:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201619.075007:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf841baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681405696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201619.075044:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3676631040 00000100:00100000:1.0:1788201619.075177:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf841baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875064681405696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (4103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201619.075186:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201619.075307:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf8333d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875064681405696:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788201619.386805:0:23563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788201619.650981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201619.651035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201619.651070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201619.651093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201619.651111:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662429696 00000100:00100000:3.0:1788201619.651113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201619.651127:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662429696 00000100:00100000:3.0:1788201619.651140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1788201619.651168:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201619.651210:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662429824 00000100:00100000:0.0:1788201619.651215:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662429824 00000100:00100000:3.0:1788201619.651221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201619.651237:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662430336 00000100:00100000:0.0:1788201619.651240:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662430336 00000100:00100000:0.0:1788201619.651256:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662430208 00000100:00100000:0.0:1788201619.651259:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662430208 00000100:00100000:3.0:1788201619.651288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1788201619.651288:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1788201619.651305:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:2400:x1875064662429696:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201619.651328:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662429952 00000100:00100000:3.0:1788201619.651334:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662429952 00000100:00100000:3.0:1788201619.651368:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662430080 00000100:00100000:3.0:1788201619.651371:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662430080 00000100:00100000:3.0:1788201619.651387:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662430464 00000100:00100000:3.0:1788201619.651390:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662430464 00000100:00100000:3.0:1788201619.651405:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662430592 00000100:00100000:3.0:1788201619.651408:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662430592 00000100:00100000:0.0:1788201619.651421:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+22:2400:x1875064662429696:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 119us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201619.651430:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201619.651432:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1788201619.651443:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662429952:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201619.651457:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:0.0:1788201619.651466:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662429824:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201619.651484:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662429952:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201619.651492:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1788201619.651498:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662429824:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201619.651506:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:3.0:1788201619.651513:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1788201619.651524:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1788201619.651526:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662430080:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201619.651536:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662430336:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1788201619.651559:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662430336:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201619.651565:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:0.0:1788201619.651578:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:3.0:1788201619.651583:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0bf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a02e8f03-e864-49bb-8879-8d6d5f03b6c1+5:2400:x1875064662430080:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 58us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201619.651590:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+6:2400:x1875064662430208:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201619.651597:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1788201619.651617:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1788201619.651620:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c996026-e1e6-4ca6-95c7-019447b48375+6:2400:x1875064662430208:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201619.651630:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:3.0:1788201619.651631:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662430464:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201619.651664:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662430464:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 38us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201619.651672:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:3.0:1788201619.651690:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1788201619.651705:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662430592:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1788201619.651733:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c996026-e1e6-4ca6-95c7-019447b48375+5:2400:x1875064662430592:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201619.651775:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1788201619.655133:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064662429568 00000100:00100000:2.0:1788201619.655152:0:22797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064662429568 00000100:00100000:2.0:1788201619.655232:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:2.0:1788201619.655246:0:22797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce0b9765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:2400:x1875064662429568:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1788201619.655364:0:22797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce0b9765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:faacd08d-6bc4-48af-a10c-977150f7f541+13:2400:x1875064662429568:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 122us (4403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201619.655373:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00080000:2.0:1788201619.655433:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201619.655441:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201619.655445:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201619.655448:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201619.768048:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201620.243508:0:25891:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788201620.790234:0:22792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201621.626508:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681405824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201621.626672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.628373:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064681405824 00000100:00100000:1.0:1788201621.628389:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064681405824 00000100:00100000:1.0:1788201621.628480:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201621.628495:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681405824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201621.628536:0:24315:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788201621.629353:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cdf837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875064681405824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 857us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.629364:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201621.629454:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cdf837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875064681405824:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201621.630454:0:22799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 13881 lines, 13881 kept, 0 dropped, 0 bad.